Nov 04 18:54:22 devstack cinder-volume[75696]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:54:22 devstack cinder-volume[75696]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:54:22 devstack cinder-volume[75696]: we strongly recommend against using it for new projects. Nov 04 18:54:22 devstack cinder-volume[75696]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:54:22 devstack cinder-volume[75696]: framework. For more detail see Nov 04 18:54:22 devstack cinder-volume[75696]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:54:22 devstack cinder-volume[75696]: import eventlet # noqa Nov 04 18:54:25 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:54:25 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:54:25 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:54:26 devstack cinder-volume[75696]: INFO dbcounter [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Registered counter for database cinder Nov 04 18:54:26 devstack cinder-volume[75696]: DEBUG oslo_db.sqlalchemy.engines [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:54:26 devstack cinder-volume[75696]: DEBUG dbcounter [-] [75696] Writer thread running {{(pid=75696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:54:26 devstack cinder-volume[75696]: INFO cinder.rpc [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:54:26 devstack cinder-volume[75696]: INFO cinder.rpc [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:54:26 devstack cinder-volume[75696]: DEBUG oslo_db.sqlalchemy.engines [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:54:27 devstack cinder-volume[75696]: INFO cinder.volume.manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Determined volume DB was empty at startup. Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG cinder.volume.manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75696) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:54:27 devstack cinder-volume[75696]: INFO cinder.volume.manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:54:27 devstack cinder-volume[75696]: WARNING stevedore.named [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:54:27 devstack cinder-volume[75696]: WARNING castellan.key_manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:54:27 devstack cinder-volume[75696]: WARNING cinder.keymgr.conf_key_mgr [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG cinder.volume.drivers.lvm [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75696) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_concurrency.processutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_concurrency.processutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] CMD "cinder-rtstool verify" returned: 0 in 0.445s {{(pid=75696) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_db.sqlalchemy.engines [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:54:27 devstack cinder-volume[75696]: INFO cinder.rpc [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 18:54:27 devstack cinder-volume[75696]: INFO cinder.rpc [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 18:54:27 devstack cinder-volume[75696]: WARNING stevedore.named [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:54:27 devstack cinder-volume[75696]: WARNING castellan.key_manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:54:27 devstack cinder-volume[75696]: INFO cinder.volume.manager [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_db.sqlalchemy.engines [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:54:27 devstack cinder-volume[75696]: INFO oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Starting 1 workers Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Started child 75827 {{(pid=75696) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Full set of CONF: {{(pid=75696) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] ******************************************************************************** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:54:27 devstack cinder-volume[75827]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Configuration options gathered from: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] ================================================================================ {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] allow_availability_zone_fallback = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] allow_compression_on_image_upload = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] allowed_direct_url_schemes = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] api_rate_limit = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] auth_strategy = keystone {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] az_cache_duration = 3600 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_availability_zone = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_host = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_stats_polling_interval = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backup_api_class = cinder.backup.api.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backup_name_template = backup-%s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backup_use_same_host = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backup_use_temp_snapshot = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] chap_password = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] chap_username = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_internal_tenant_project_id = 53f18f1dddc6471da0a519e6b5fdd0ad {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_internal_tenant_user_id = 06c7ea23fd904837b51bdd833cb1615d {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cloned_volume_same_az = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cluster = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] compression_format = gzip {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] compute_api_class = cinder.compute.nova.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] config_dir = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] config_source = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] control_exchange = openstack {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] debug = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] default_availability_zone = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] default_group_type = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] default_volume_type = lvmdriver-1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] disk_geometry = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_client_cert = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_client_cert_key = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_data_namespace = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_ssl_cert_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_ssl_cert_verify = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] driver_use_ssl = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] enable_force_upload = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] enable_new_services = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] enable_unsupported_driver = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] enforce_multipath_for_image_xfer = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] filter_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_api_insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_api_ssl_compression = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_ca_certificates_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_catalog_info = image:glance:publicURL {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_num_retries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance_request_timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] goodness_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] graceful_shutdown_timeout = 5 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] group_api_class = cinder.group.api.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] host = devstack {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_compress_on_upload = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_conversion_address_space_limit = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_conversion_cpu_limit = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_conversion_disable = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_introspection_address_space_limit = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_introspection_cpu_limit = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_upload_use_cinder_backend = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_upload_use_internal_tenant = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_volume_cache_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_volume_cache_max_count = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] image_volume_cache_max_size_gb = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] init_host_max_objects_retrieval = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] instance_format = [instance: %(uuid)s] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iscsi_target_flags = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iscsi_write_cache = on {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iser_helper = tgtadm {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iser_ip_address = 192.168.122.69 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iser_port = 3260 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_color = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_config_append = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_dir = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_options = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_rotate_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_rotate_interval_type = days {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] log_rotation_type = none {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75827]: INFO cinder.volume.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] max_age = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] max_logfile_count = 30 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] max_logfile_size_mb = 200 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] max_over_subscription_ratio = 20.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] message_reap_interval = 86400 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] message_ttl = 2592000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] migration_create_volume_timeout_secs = 300 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] monkey_patch = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] monkey_patch_modules = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] my_ip = 192.168.122.69 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] no_snapshot_gb_quota = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] num_iser_scan_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] num_shell_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] num_volume_device_scan_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] nvmeof_conn_info_version = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] nvmet_ns_id = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] nvmet_port_id = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_max_limit = 1000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_ext_list = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_listen_port = 8776 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_use_ssl = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] osapi_volume_workers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] per_volume_size_limit = -1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] periodic_fuzzy_delay = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] periodic_interval = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] public_endpoint = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] publish_errors = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_backup_gigabytes = 1000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_backups = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_gigabytes = 1000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_groups = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_snapshots = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] quota_volumes = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] rate_limit_burst = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] rate_limit_except_level = CRITICAL {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] rate_limit_interval = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] reinit_driver_count = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] replication_device = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] report_discard_supported = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] report_interval = 120 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] reservation_clean_interval = 86400 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] reservation_expire = 86400 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] reserved_image_namespaces = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] reserved_percentage = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] rpc_response_timeout = 120 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] run_external_periodic_tasks = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] scst_target_driver = iscsi {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] scst_target_iqn_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_down_time = 720 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] shell_completion = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] snapshot_name_template = snapshot-%s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] snapshot_same_host = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] split_loggers = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] state_path = /opt/stack/data/cinder {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] storage_availability_zone = nova {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] storage_protocol = iSCSI {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] syslog_log_facility = LOG_USER {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_helper = lioadm {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_ip_address = 192.168.122.69 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_port = 3260 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_protocol = iscsi {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] target_secondary_ip_addresses = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] trace_flags = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] transport_url = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] until_refresh = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_chap_auth = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_default_quota_class = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_journal = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_json = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_multipath_for_image_xfer = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_stderr = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] use_syslog = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] verify_glance_signatures = enabled {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_api_class = cinder.volume.api.API {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_backend_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_clear = zero {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_clear_ionice = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_clear_size = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_copy_bps_limit = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_dd_blocksize = 1M {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_name_template = volume-%s {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_service_inithost_offload = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volume_usage_audit_period = month {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] zoning_mode = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_concurrency.disable_process_locking = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.auth_section = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.auth_type = password {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.auth_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.cache = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.include_service_catalog = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.interface = public {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_password = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcache_username = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.region_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.service_type = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.backend = dogpile.cache.null {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.backend_argument = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.backend_expiration_time = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.config_prefix = cache.oslo {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.debug_cache_backend = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.enable_retry_client = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.enable_socket_keepalive = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.expiration_time = 600 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.hashclient_retry_attempts = 2 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_dead_retry = 300 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_pool_maxsize = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_sasl_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.password = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.proxies = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.redis_db = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.redis_server = localhost:6379 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.retry_attempts = 2 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.retry_delay = 0.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.socket_keepalive_count = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.socket_keepalive_idle = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.socket_keepalive_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.socket_timeout = 1.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.tls_allowed_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.tls_cafile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.tls_certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.tls_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.tls_keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cache.username = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] coordination.backend_url = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.asyncio_connection = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.asyncio_slave_connection = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.backend = sqlalchemy {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.connection = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.connection_debug = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.connection_parameters = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.connection_recycle_time = 3600 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.connection_trace = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.db_inc_retry_interval = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.db_max_retries = 20 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.db_max_retry_interval = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.db_retry_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.max_overflow = 50 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.max_pool_size = 5 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.max_retries = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.mysql_wsrep_sync_wait = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.pool_timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.retry_interval = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.slave_connection = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.sqlite_synchronous = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.synchronous_reader = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] database.use_db_reconnect = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_tracing.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.connection_string = messaging:// {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.es_doc_type = notification {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.es_scroll_size = 10000 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.es_scroll_time = 2m {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.filter_error_trace = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.hmac_keys = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.sentinel_service_name = mymaster {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.socket_timeout = 0.1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.trace_requests = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler.trace_sqlalchemy = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler_jaeger.process_tags = {} {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler_jaeger.service_name_prefix = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] profiler_otlp.service_name_prefix = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.enforce_new_defaults = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.policy_default_rule = default {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.policy_file = policy.yaml {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.group = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.helper_command = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] privsep_osbrick.user = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.group = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.helper_command = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] cinder_sys_admin.user = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.auth_section = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.auth_type = password {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.cafile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.collect_timing = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.send_service_user_token = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.split_loggers = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.tls_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] service_user.tls_min_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.auth_section = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.auth_type = password {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.collect_timing = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.region_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.split_loggers = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.tls_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] glance.tls_min_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.backend_availability_zone = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.chap_password = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.chap_username = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.disk_geometry = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_client_cert = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_client_cert_key = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_data_namespace = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.driver_use_ssl = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.extra_capabilities = {} {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.filter_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.goodness_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iscsi_target_flags = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iscsi_write_cache = on {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iser_helper = tgtadm {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iser_port = 3260 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.lvm_share_target = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.lvm_type = auto {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.num_shell_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.replication_device = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.report_discard_supported = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.reserved_percentage = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_helper = tgtadm {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_port = 3260 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack sudo[75884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_protocol = iscsi {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.trace_flags = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.unique_fqdn_network = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.use_chap_auth = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack sudo[75884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_backend_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_clear = zero {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_clear_ionice = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_clear_size = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_reports.file_event_handler = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_reports.log_dir = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.backend_host = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.chap_password = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.chap_username = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.disk_geometry = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_client_cert = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.extra_capabilities = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.filter_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.goodness_function = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iser_helper = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iser_ip_address = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iser_port = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.lvm_share_target = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.lvm_type = auto {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.num_shell_tries = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.replication_device = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.report_discard_supported = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.reserved_percentage = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.scst_target_driver = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.storage_protocol = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_helper = lioadm {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_ip_address = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_port = 3260 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.trace_flags = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.use_chap_auth = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_clear = zero {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_clear_size = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] lvmdriver-1.volumes_dir = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:27 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_notifications.driver = [] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_notifications.retry = -1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] key_manager.fixed_key = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.barbican_api_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.barbican_endpoint = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.barbican_endpoint_type = public {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.barbican_region_name = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.cafile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.collect_timing = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.number_of_retries = 60 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.retry_delay = 1 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.send_service_user_token = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.split_loggers = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.tls_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.tls_min_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.verify_ssl = True {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican.verify_ssl_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.auth_section = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.auth_type = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.cafile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.certfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.collect_timing = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.insecure = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.keyfile = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.split_loggers = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.timeout = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.tls_ciphers = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] barbican_service_user.tls_min_version = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.approle_role_id = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.approle_secret_id = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.auth_method = approle {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.auth_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.kv_mountpoint = secret {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.kv_path = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.kv_version = 2 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.namespace = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.root_token_id = **** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.ssl_ca_crt_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.timeout = 60.0 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.token_file = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.token_role = None {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.use_ssl = False {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:54:28 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] ******************************************************************************** {{(pid=75696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:54:28 devstack sudo[75884]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:28 devstack sudo[75992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:28 devstack sudo[75992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:28 devstack sudo[75992]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:54:28 devstack cinder-volume[75827]: INFO cinder.brick.local_dev.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:28 devstack sudo[76078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:28 devstack sudo[76078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:28 devstack sudo[76078]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG cinder.brick.local_dev.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75827) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 18:54:28 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:28 devstack sudo[76167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:28 devstack sudo[76167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:29 devstack sudo[76167]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.595s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:29 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:29 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:29 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.359s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:29 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:29 devstack sudo[76438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 18:54:29 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:30 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:30 devstack sudo[76446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:30 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:30 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:30 devstack sudo[76526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:30 devstack sudo[76526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:30 devstack sudo[76526]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:30 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:30 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:30 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:31 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack sudo[76622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:31 devstack sudo[76622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[76622]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: INFO cinder.volume.drivers.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack sudo[76633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:31 devstack sudo[76633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:31 devstack sudo[76633]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:54:31 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:31 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:31 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:32 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:32 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:32 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:32 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:32 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:32 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:32 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:32 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:32 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:32 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:33 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:33 devstack cinder-volume[75827]: INFO cinder.volume.driver [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG cinder.volume.driver [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75827) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_db.sqlalchemy.engines [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75827) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writer thread running {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG cinder.db.api [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Building query based on filter {{(pid=75827) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG cinder.image.image_utils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75827) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:54:33 devstack cinder-volume[75827]: INFO cinder.keymgr.migration [None req-b958a122-8df3-4607-bf32-a2dad7fc1b20 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:33 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:33 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:33 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:33 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:33 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:33 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:33 devstack sudo[76659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:33 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:33 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:33 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[76662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:34 devstack sudo[76662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:34 devstack sudo[76662]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG cinder.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Notifying Schedulers of capabilities ... {{(pid=75827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:34 devstack cinder-volume[75827]: INFO cinder.volume.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Driver initialization completed successfully. Nov 04 18:54:34 devstack cinder-volume[75827]: INFO cinder.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Initiating service 2 cleanup Nov 04 18:54:34 devstack cinder-volume[75827]: INFO cinder.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Service 2 cleanup completed. Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG cinder.service [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Creating RPC server for service cinder-volume {{(pid=75827) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG cinder.service [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75827) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:54:34 devstack cinder-volume[75827]: INFO cinder.volume.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:54:34 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:34 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:34 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[76671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:34 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:35 devstack sudo[76677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:54:35 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:35 devstack sudo[76680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:54:35 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[75827]: INFO cinder.volume.manager [None req-f54be832-0646-4e77-969a-eb8ac97f8080 None None] Driver post RPC initialization completed successfully. Nov 04 18:54:37 devstack cinder-volume[75696]: DEBUG dbcounter [-] [75696] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:44 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:45 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:47 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager._thread_info {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:54:47 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread count: 6 {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:54:47 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread info: [<_MainThread(MainThread, started 125256886599808)>, , , , , ] {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:55:47 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:47 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:55:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[79356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:55:47 devstack sudo[79356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[79356]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[79359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:55:48 devstack sudo[79359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:48 devstack sudo[79359]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:48 devstack sudo[79362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:55:48 devstack sudo[79362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:48 devstack sudo[79362]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:48 devstack sudo[79367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:55:48 devstack sudo[79367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:48 devstack sudo[79367]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG cinder.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Notifying Schedulers of capabilities ... {{(pid=75827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager._thread_info {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread count: 6 {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:55:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread info: [<_MainThread(MainThread, started 125256886599808)>, , , , , ] {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:56:45 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:SELECT=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:45 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:UPDATE=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:47 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:47 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:56:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:47 devstack sudo[82473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:56:47 devstack sudo[82473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:47 devstack sudo[82473]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[82510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:56:48 devstack sudo[82510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack sudo[82510]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[82513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:56:48 devstack sudo[82513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack sudo[82513]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[82556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:56:48 devstack sudo[82556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack sudo[82556]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG cinder.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Notifying Schedulers of capabilities ... {{(pid=75827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager._thread_info {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread count: 6 {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:56:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread info: [<_MainThread(MainThread, started 125256886599808)>, , , , , ] {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:57:47 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:57:47 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:57:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:47 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:57:47 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:47 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:47 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:57:47 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:48 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:48 devstack sudo[84627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:57:48 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:48 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:48 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:57:48 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:48 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[75827]: DEBUG cinder.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Notifying Schedulers of capabilities ... {{(pid=75827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:45 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:SELECT=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:45 devstack cinder-volume[75827]: DEBUG dbcounter [-] [75827] Writing DB stats cinder:UPDATE=1 {{(pid=75827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:47 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:47 devstack cinder-volume[75827]: DEBUG cinder.volume.drivers.lvm [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Updating volume stats {{(pid=75827) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:58:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:47 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:58:47 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:47 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:47 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:47 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:58:47 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:58:48 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:58:48 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_concurrency.processutils [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG cinder.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Notifying Schedulers of capabilities ... {{(pid=75827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG oslo_service.periodic_task [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] Running periodic task VolumeManager._thread_info {{(pid=75827) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread count: 6 {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:58:48 devstack cinder-volume[75827]: DEBUG cinder.volume.manager [None req-3e9f0371-cc0e-4529-8147-386303c2b494 None None] thread info: [<_MainThread(MainThread, started 125256886599808)>, , , , , ] {{(pid=75827) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:59:09 devstack cinder-volume[75696]: INFO oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Caught SIGTERM, stopping children Nov 04 18:59:09 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Acquiring lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:09 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Acquired lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:09 devstack cinder-volume[75696]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Releasing lock "singleton_lock" {{(pid=75696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:09 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Stop services. {{(pid=75696) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:59:09 devstack cinder-volume[75696]: DEBUG oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Killing children. {{(pid=75696) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:59:09 devstack cinder-volume[75696]: INFO oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Waiting on 1 children to exit Nov 04 18:59:14 devstack cinder-volume[75827]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Acquiring lock "singleton_lock" {{(pid=75827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:14 devstack cinder-volume[75827]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Acquired lock "singleton_lock" {{(pid=75827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:14 devstack cinder-volume[75827]: DEBUG oslo_concurrency.lockutils [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Releasing lock "singleton_lock" {{(pid=75827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:14 devstack cinder-volume[75827]: WARNING amqp [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:59:14 devstack cinder-volume[75827]: WARNING amqp [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:59:14 devstack cinder-volume[75696]: INFO oslo_service.backend._eventlet.service [None req-a133f678-932f-4a2a-b97b-8d3870b4e565 None None] Child 75827 exited with status 0 Nov 04 18:59:14 devstack cinder-volume[86395]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:59:14 devstack cinder-volume[86395]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:59:14 devstack cinder-volume[86395]: we strongly recommend against using it for new projects. Nov 04 18:59:14 devstack cinder-volume[86395]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:59:14 devstack cinder-volume[86395]: framework. For more detail see Nov 04 18:59:14 devstack cinder-volume[86395]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:59:14 devstack cinder-volume[86395]: import eventlet # noqa Nov 04 18:59:17 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:17 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:17 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:17 devstack cinder-volume[86395]: INFO dbcounter [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Registered counter for database cinder Nov 04 18:59:18 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:18 devstack cinder-volume[86395]: DEBUG dbcounter [-] [86395] Writer thread running {{(pid=86395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:59:18 devstack cinder-volume[86395]: INFO cinder.rpc [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:59:18 devstack cinder-volume[86395]: INFO cinder.rpc [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:59:18 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:18 devstack cinder-volume[86395]: INFO cinder.volume.manager [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Determined volume DB was empty at startup. Nov 04 18:59:18 devstack cinder-volume[86395]: DEBUG cinder.volume.manager [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86395) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:59:18 devstack cinder-volume[86395]: INFO cinder.volume.manager [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:59:18 devstack cinder-volume[86395]: WARNING stevedore.named [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:59:18 devstack cinder-volume[86395]: WARNING castellan.key_manager [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:59:18 devstack cinder-volume[86395]: WARNING cinder.keymgr.conf_key_mgr [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:59:18 devstack cinder-volume[86395]: INFO cinder.volume.manager [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:59:18 devstack cinder-volume[86395]: DEBUG oslo_db.sqlalchemy.engines [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86395) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:19 devstack cinder-volume[86395]: INFO oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Starting 1 workers Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Started child 86686 {{(pid=86395) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Full set of CONF: {{(pid=86395) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] ******************************************************************************** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Configuration options gathered from: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] ================================================================================ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] allow_availability_zone_fallback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] allow_compression_on_image_upload = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] allowed_direct_url_schemes = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] api_rate_limit = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] auth_strategy = keystone {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_stats_polling_interval = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86686]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backup_api_class = cinder.backup.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backup_name_template = backup-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backup_use_same_host = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backup_use_temp_snapshot = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] chap_username = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_internal_tenant_project_id = 53f18f1dddc6471da0a519e6b5fdd0ad {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_internal_tenant_user_id = 06c7ea23fd904837b51bdd833cb1615d {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cluster = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] compression_format = gzip {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] compute_api_class = cinder.compute.nova.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] config_dir = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] config_source = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] control_exchange = openstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] debug = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] default_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] default_group_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] default_volume_type = QuobyteHD {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_ssl_cert_verify = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] driver_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] enable_new_services = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] enable_unsupported_driver = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] enabled_backends = ['QuobyteHD'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] enforce_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_api_insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_api_ssl_compression = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_ca_certificates_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_catalog_info = image:glance:publicURL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_num_retries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance_request_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] graceful_shutdown_timeout = 5 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] group_api_class = cinder.group.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] host = devstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_compress_on_upload = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_conversion_address_space_limit = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_conversion_cpu_limit = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_conversion_disable = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_introspection_address_space_limit = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_introspection_cpu_limit = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_upload_use_cinder_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_upload_use_internal_tenant = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_volume_cache_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_volume_cache_max_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] image_volume_cache_max_size_gb = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] init_host_max_objects_retrieval = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] instance_format = [instance: %(uuid)s] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iscsi_target_flags = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iscsi_write_cache = on {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iser_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iser_ip_address = 192.168.122.69 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iser_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_color = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_config_append = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_options = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_rotate_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_rotate_interval_type = days {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] log_rotation_type = none {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] max_age = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] max_logfile_count = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] max_logfile_size_mb = 200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] max_over_subscription_ratio = 20.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] message_reap_interval = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] message_ttl = 2592000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] migration_create_volume_timeout_secs = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] monkey_patch = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] monkey_patch_modules = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] my_ip = 192.168.122.69 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] no_snapshot_gb_quota = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] num_iser_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] num_shell_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] num_volume_device_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] nvmeof_conn_info_version = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] nvmet_ns_id = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] nvmet_port_id = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_max_limit = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_ext_list = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_listen_port = 8776 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] osapi_volume_workers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] per_volume_size_limit = -1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86686]: INFO cinder.volume.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] periodic_fuzzy_delay = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.remotefs [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86686) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] periodic_interval = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] public_endpoint = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] publish_errors = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_backup_gigabytes = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_backups = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_gigabytes = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_groups = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_snapshots = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] quota_volumes = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] rate_limit_burst = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] rate_limit_except_level = CRITICAL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] rate_limit_interval = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] reinit_driver_count = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] report_discard_supported = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] report_interval = 120 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] reservation_clean_interval = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] reservation_expire = 86400 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] reserved_image_namespaces = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] reserved_percentage = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] rpc_response_timeout = 120 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] run_external_periodic_tasks = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] scst_target_driver = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_down_time = 720 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] shell_completion = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] snapshot_name_template = snapshot-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] state_path = /opt/stack/data/cinder {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] storage_availability_zone = nova {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] storage_protocol = iSCSI {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] syslog_log_facility = LOG_USER {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_helper = lioadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_ip_address = 192.168.122.69 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_protocol = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] target_secondary_ip_addresses = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] transport_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] until_refresh = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_chap_auth = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_default_quota_class = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_journal = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_json = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_stderr = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] use_syslog = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] verify_glance_signatures = enabled {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_api_class = cinder.volume.api.API {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_clear = zero {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_clear_size = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_copy_bps_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_dd_blocksize = 1M {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_name_template = volume-%s {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_service_inithost_offload = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volume_usage_audit_period = month {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] zoning_mode = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_concurrency.disable_process_locking = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.auth_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.include_service_catalog = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.interface = public {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcache_username = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.service_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.backend = dogpile.cache.null {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.backend_argument = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.backend_expiration_time = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.config_prefix = cache.oslo {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.debug_cache_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.enable_retry_client = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.enable_socket_keepalive = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.expiration_time = 600 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.hashclient_retry_attempts = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_dead_retry = 300 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_pool_maxsize = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_sasl_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.proxies = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.redis_db = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.redis_server = localhost:6379 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.retry_attempts = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.retry_delay = 0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.socket_keepalive_count = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.socket_keepalive_idle = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.socket_keepalive_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.socket_timeout = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.tls_allowed_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.tls_cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.tls_certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.tls_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.tls_keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cache.username = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] coordination.backend_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.asyncio_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.asyncio_slave_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.backend = sqlalchemy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.connection_debug = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.connection_parameters = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.connection_recycle_time = 3600 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.connection_trace = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.db_inc_retry_interval = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.db_max_retries = 20 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.db_max_retry_interval = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.db_retry_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.max_overflow = 50 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.max_pool_size = 5 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.max_retries = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.mysql_wsrep_sync_wait = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.pool_timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.retry_interval = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.slave_connection = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.sqlite_synchronous = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.synchronous_reader = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] database.use_db_reconnect = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_tracing.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.connection_string = messaging:// {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.es_doc_type = notification {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.es_scroll_size = 10000 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.es_scroll_time = 2m {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.filter_error_trace = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.hmac_keys = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.sentinel_service_name = mymaster {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.socket_timeout = 0.1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.trace_requests = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler.trace_sqlalchemy = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler_jaeger.process_tags = {} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler_jaeger.service_name_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] profiler_otlp.service_name_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.enforce_new_defaults = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.policy_default_rule = default {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.policy_file = policy.yaml {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.group = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.helper_command = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] privsep_osbrick.user = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.group = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.helper_command = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] cinder_sys_admin.user = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.send_service_user_token = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.tls_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] service_user.tls_min_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.auth_type = password {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.tls_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] glance.tls_min_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.chap_username = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.driver_use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.extra_capabilities = {} {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iscsi_target_flags = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iscsi_write_cache = on {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iser_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iser_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_host = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_login = admin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_mount_options = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_private_key = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_share_path = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.num_shell_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.quobyte_volume_url = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.report_discard_supported = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.reserved_percentage = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_helper = tgtadm {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_port = 3260 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_protocol = iscsi {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.unique_fqdn_network = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.use_chap_auth = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_backend_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_clear = zero {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_clear_size = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_reports.file_event_handler = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_reports.log_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.backend_availability_zone = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.backend_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.chap_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.chap_username = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.chiscsi_conf = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.disk_geometry = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_client_cert = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_data_namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.driver_use_ssl = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.extra_capabilities = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.filter_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.goodness_function = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iser_helper = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iser_ip_address = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iser_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.iser_target_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86686) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_host = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86686]: WARNING cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_login = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_mount_options = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_password = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_private_key = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_share_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_ssh_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86686]: WARNING cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.num_shell_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.nvmet_port_id = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.replication_device = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.report_discard_supported = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.reserved_percentage = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.scst_target_driver = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.storage_protocol = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_helper = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_ip_address = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_port = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_prefix = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_protocol = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.trace_flags = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.use_chap_auth = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_clear = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_clear_size = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] QuobyteHD.volumes_dir = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_notifications.driver = [] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_notifications.retry = -1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] key_manager.fixed_key = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.barbican_api_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.barbican_endpoint = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.barbican_endpoint_type = public {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.barbican_region_name = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.number_of_retries = 60 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.retry_delay = 1 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.send_service_user_token = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.tls_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.tls_min_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.verify_ssl = True {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican.verify_ssl_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.auth_section = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.auth_type = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.cafile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.certfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.collect_timing = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.insecure = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.keyfile = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.split_loggers = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.timeout = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.tls_ciphers = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] barbican_service_user.tls_min_version = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.approle_role_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.approle_secret_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.auth_method = approle {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.auth_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.kv_mountpoint = secret {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.kv_path = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.kv_version = 2 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.namespace = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.root_token_id = **** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.ssl_ca_crt_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.timeout = 60.0 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.token_file = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.token_role = None {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.use_ssl = False {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:19 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] ******************************************************************************** {{(pid=86395) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:59:19 devstack quobyte-client[86687]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:59:19 devstack quobyte-client[86687]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=86686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:19 devstack cinder-volume[86686]: INFO cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f ... Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 -c /etc/quobyte/client-cinder.cfg {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:19 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 -c /etc/quobyte/client-cinder.cfg Nov 04 18:59:19 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:19 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.480s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:19 devstack cinder-volume[86686]: INFO cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f succeeded Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=86686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.493s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:19 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:19 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:19 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:20 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.259s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.volume.driver [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.volume.driver [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5200576782227, 'free_capacity_gb': 1773.5200576782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86686) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86686) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG dbcounter [-] [86686] Writer thread running {{(pid=86686) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.db.api [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Building query based on filter {{(pid=86686) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.image.image_utils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86686) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.keymgr.migration [None req-87604d08-a8af-416d-81c3-7f7358134d10 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=86686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=86686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:20 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:20 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:20 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.255s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Notifying Schedulers of capabilities ... {{(pid=86686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.volume.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Driver initialization completed successfully. Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Initiating service 3 cleanup Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Service 3 cleanup completed. Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.service [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Creating RPC server for service cinder-volume {{(pid=86686) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.service [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86686) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:59:20 devstack cinder-volume[86686]: INFO cinder.volume.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=86686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=86686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:20 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:20 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:20 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:21 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:21 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.409s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:21 devstack cinder-volume[86686]: INFO cinder.volume.manager [None req-8e9605d6-bc95-4c6a-bdff-642566d2dac7 None None] Driver post RPC initialization completed successfully. Nov 04 18:59:24 devstack cinder-volume[86686]: DEBUG oslo_service.periodic_task [None req-bcc2cb00-e5ac-4359-bc06-a4e8d0180844 None None] Running periodic task VolumeManager._thread_info {{(pid=86686) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:59:24 devstack cinder-volume[86686]: DEBUG cinder.volume.manager [None req-bcc2cb00-e5ac-4359-bc06-a4e8d0180844 None None] thread count: 6 {{(pid=86686) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:59:24 devstack cinder-volume[86686]: DEBUG cinder.volume.manager [None req-bcc2cb00-e5ac-4359-bc06-a4e8d0180844 None None] thread info: [<_MainThread(MainThread, started 140086943236224)>, , , , , ] {{(pid=86686) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=86686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG cinder.volume.drivers.quobyte [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=86686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86686) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:26 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:26 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:26 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG oslo_concurrency.processutils [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.262s {{(pid=86686) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:26 devstack cinder-volume[86686]: DEBUG cinder.manager [None req-3622c2e1-58d0-4a8c-8908-ba76a595cb3a None None] Notifying Schedulers of capabilities ... {{(pid=86686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG dbcounter [-] [86395] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86395) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:29 devstack cinder-volume[86395]: INFO oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Caught SIGTERM, stopping children Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Acquiring lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Acquired lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Releasing lock "singleton_lock" {{(pid=86395) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Stop services. {{(pid=86395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:59:29 devstack cinder-volume[86395]: DEBUG oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Killing children. {{(pid=86395) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:59:29 devstack cinder-volume[86395]: INFO oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Waiting on 1 children to exit Nov 04 18:59:31 devstack cinder-volume[86686]: DEBUG dbcounter [-] [86686] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86686) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:31 devstack cinder-volume[86686]: DEBUG dbcounter [-] [86686] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86686) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:33 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Acquiring lock "singleton_lock" {{(pid=86686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:33 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Acquired lock "singleton_lock" {{(pid=86686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:33 devstack cinder-volume[86686]: DEBUG oslo_concurrency.lockutils [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Releasing lock "singleton_lock" {{(pid=86686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:33 devstack cinder-volume[86686]: WARNING amqp [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:59:33 devstack cinder-volume[86686]: WARNING amqp [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:59:33 devstack cinder-volume[86395]: INFO oslo_service.backend._eventlet.service [None req-c161beed-f0ea-4b57-8a6a-4c0b2194a062 None None] Child 86686 exited with status 0 Nov 04 18:59:34 devstack cinder-volume[87111]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:59:34 devstack cinder-volume[87111]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:59:34 devstack cinder-volume[87111]: we strongly recommend against using it for new projects. Nov 04 18:59:34 devstack cinder-volume[87111]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:59:34 devstack cinder-volume[87111]: framework. For more detail see Nov 04 18:59:34 devstack cinder-volume[87111]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:59:34 devstack cinder-volume[87111]: import eventlet # noqa Nov 04 18:59:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87111) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:59:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87111) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:59:37 devstack cinder-volume[87111]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87111) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:59:38 devstack cinder-volume[87111]: INFO dbcounter [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Registered counter for database cinder Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writer thread running {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:59:38 devstack cinder-volume[87111]: INFO cinder.rpc [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:59:38 devstack cinder-volume[87111]: INFO cinder.rpc [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Determined volume DB was empty at startup. Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG cinder.volume.manager [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87111) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:59:38 devstack cinder-volume[87111]: WARNING stevedore.named [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:59:38 devstack cinder-volume[87111]: WARNING castellan.key_manager [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:59:38 devstack cinder-volume[87111]: WARNING cinder.keymgr.conf_key_mgr [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:59:38 devstack cinder-volume[87111]: INFO cinder.volume.manager [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:38 devstack cinder-volume[87111]: INFO oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Starting 1 workers Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Started child 87367 {{(pid=87111) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Full set of CONF: {{(pid=87111) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] ******************************************************************************** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] Configuration options gathered from: {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] ================================================================================ {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:59:38 devstack cinder-volume[87367]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] allow_availability_zone_fallback = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] allow_compression_on_image_upload = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] allowed_direct_url_schemes = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] api_rate_limit = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] auth_strategy = keystone {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_availability_zone = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_host = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_stats_polling_interval = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backup_api_class = cinder.backup.api.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backup_name_template = backup-%s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backup_use_same_host = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backup_use_temp_snapshot = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] chap_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] chap_username = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_internal_tenant_project_id = 53f18f1dddc6471da0a519e6b5fdd0ad {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_internal_tenant_user_id = 06c7ea23fd904837b51bdd833cb1615d {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cluster = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] compression_format = gzip {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] compute_api_class = cinder.compute.nova.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] config_dir = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] config_source = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] control_exchange = openstack {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] debug = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] default_availability_zone = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] default_group_type = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] default_volume_type = QuobyteHD {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] disk_geometry = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_client_cert = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_client_cert_key = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_data_namespace = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_ssl_cert_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_ssl_cert_verify = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] driver_use_ssl = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] enable_new_services = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] enable_unsupported_driver = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] enabled_backends = ['QuobyteHD'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] enforce_multipath_for_image_xfer = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] filter_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_api_insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_api_ssl_compression = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_ca_certificates_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_catalog_info = image:glance:publicURL {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_num_retries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance_request_timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] goodness_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] graceful_shutdown_timeout = 5 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] group_api_class = cinder.group.api.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] host = devstack {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_compress_on_upload = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_conversion_address_space_limit = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_conversion_cpu_limit = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_conversion_disable = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_introspection_address_space_limit = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_introspection_cpu_limit = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_upload_use_cinder_backend = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_upload_use_internal_tenant = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_volume_cache_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_volume_cache_max_count = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] image_volume_cache_max_size_gb = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] init_host_max_objects_retrieval = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] instance_format = [instance: %(uuid)s] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iscsi_target_flags = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iscsi_write_cache = on {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iser_helper = tgtadm {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iser_ip_address = 192.168.122.69 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iser_port = 3260 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_color = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:38 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_config_append = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_dir = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_options = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_rotate_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_rotate_interval_type = days {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] log_rotation_type = none {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] max_age = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] max_logfile_count = 30 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] max_logfile_size_mb = 200 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] max_over_subscription_ratio = 20.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] message_reap_interval = 86400 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] message_ttl = 2592000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] migration_create_volume_timeout_secs = 300 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] monkey_patch = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] monkey_patch_modules = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] my_ip = 192.168.122.69 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] no_snapshot_gb_quota = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] num_iser_scan_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] num_shell_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] num_volume_device_scan_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] nvmeof_conn_info_version = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] nvmet_ns_id = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] nvmet_port_id = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_max_limit = 1000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87367) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_ext_list = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_listen_port = 8776 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_use_ssl = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] osapi_volume_workers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] per_volume_size_limit = -1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] periodic_fuzzy_delay = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] periodic_interval = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] public_endpoint = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] publish_errors = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_backup_gigabytes = 1000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_backups = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_gigabytes = 1000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_groups = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_snapshots = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] quota_volumes = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] rate_limit_burst = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] rate_limit_except_level = CRITICAL {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] rate_limit_interval = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] reinit_driver_count = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] replication_device = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] report_discard_supported = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] report_interval = 120 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] reservation_clean_interval = 86400 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] reservation_expire = 86400 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] reserved_image_namespaces = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] reserved_percentage = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] rpc_response_timeout = 120 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] run_external_periodic_tasks = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] scst_target_driver = iscsi {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] scst_target_iqn_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_down_time = 720 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] shell_completion = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] snapshot_name_template = snapshot-%s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] split_loggers = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] state_path = /opt/stack/data/cinder {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] storage_availability_zone = nova {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] storage_protocol = iSCSI {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] syslog_log_facility = LOG_USER {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_helper = lioadm {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_ip_address = 192.168.122.69 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_port = 3260 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_protocol = iscsi {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] target_secondary_ip_addresses = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] trace_flags = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] transport_url = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] until_refresh = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_chap_auth = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_default_quota_class = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_journal = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_json = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_multipath_for_image_xfer = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_stderr = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] use_syslog = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] verify_glance_signatures = enabled {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_api_class = cinder.volume.api.API {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_backend_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_clear = zero {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_clear_ionice = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_clear_size = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_copy_bps_limit = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_dd_blocksize = 1M {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_name_template = volume-%s {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_service_inithost_offload = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volume_usage_audit_period = month {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] zoning_mode = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_concurrency.disable_process_locking = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.auth_section = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.auth_type = password {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.auth_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.cache = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.include_service_catalog = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.interface = public {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcache_username = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.region_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.service_type = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.backend = dogpile.cache.null {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.backend_argument = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.backend_expiration_time = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.config_prefix = cache.oslo {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.debug_cache_backend = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.enable_retry_client = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.enable_socket_keepalive = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.expiration_time = 600 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.hashclient_retry_attempts = 2 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_dead_retry = 300 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_pool_maxsize = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_sasl_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.proxies = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.redis_db = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.redis_server = localhost:6379 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.retry_attempts = 2 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.retry_delay = 0.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.socket_keepalive_count = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.socket_keepalive_idle = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.socket_keepalive_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.socket_timeout = 1.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.tls_allowed_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.tls_cafile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.tls_certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.tls_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.tls_keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cache.username = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] coordination.backend_url = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.asyncio_connection = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.asyncio_slave_connection = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.backend = sqlalchemy {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.connection = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.connection_debug = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.connection_parameters = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.connection_recycle_time = 3600 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.connection_trace = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.db_inc_retry_interval = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.db_max_retries = 20 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.db_max_retry_interval = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87367) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:59:39 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.db_retry_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.max_overflow = 50 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.max_pool_size = 5 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.max_retries = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.mysql_wsrep_sync_wait = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.pool_timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.retry_interval = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.slave_connection = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.sqlite_synchronous = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Running cmd (subprocess): mount.quobyte {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.synchronous_reader = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] database.use_db_reconnect = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_tracing.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.connection_string = messaging:// {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.es_doc_type = notification {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.es_scroll_size = 10000 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.es_scroll_time = 2m {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.filter_error_trace = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.hmac_keys = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.sentinel_service_name = mymaster {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.socket_timeout = 0.1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.trace_requests = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler.trace_sqlalchemy = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler_jaeger.process_tags = {} {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler_jaeger.service_name_prefix = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] profiler_otlp.service_name_prefix = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.enforce_new_defaults = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.policy_default_rule = default {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.policy_file = policy.yaml {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.group = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.helper_command = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] privsep_osbrick.user = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.group = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.helper_command = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] cinder_sys_admin.user = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.auth_section = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.auth_type = password {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.cafile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.collect_timing = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.send_service_user_token = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.split_loggers = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.tls_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] service_user.tls_min_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.auth_section = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.auth_type = password {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.collect_timing = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.region_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.split_loggers = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.tls_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] glance.tls_min_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.backend_availability_zone = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.chap_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.chap_username = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.disk_geometry = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_client_cert = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_client_cert_key = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_data_namespace = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.driver_use_ssl = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.extra_capabilities = {} {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.filter_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.goodness_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iscsi_target_flags = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iscsi_write_cache = on {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iser_helper = tgtadm {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iser_port = 3260 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_host = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_login = admin {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_mount_options = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_private_key = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_share_path = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.num_shell_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.quobyte_volume_url = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.replication_device = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.report_discard_supported = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.reserved_percentage = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_helper = tgtadm {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_port = 3260 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_protocol = iscsi {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.trace_flags = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.unique_fqdn_network = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.use_chap_auth = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_backend_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_clear = zero {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_clear_ionice = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_clear_size = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_reports.file_event_handler = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_reports.log_dir = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.backend_availability_zone = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.backend_host = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.chap_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack quobyte-client[87368]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.chap_username = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.chiscsi_conf = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.disk_geometry = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_client_cert = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_data_namespace = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack quobyte-client[87368]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.driver_use_ssl = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.extra_capabilities = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.filter_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.goodness_function = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iser_helper = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iser_ip_address = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iser_port = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.iser_target_prefix = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_host = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_login = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_mount_options = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_password = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_private_key = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_share_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_ssh_port = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.num_shell_tries = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.nvmet_port_id = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.replication_device = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.report_discard_supported = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.reserved_percentage = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.scst_target_driver = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.storage_protocol = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_helper = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_ip_address = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_port = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_prefix = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_protocol = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.trace_flags = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.use_chap_auth = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_clear = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_clear_size = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] QuobyteHD.volumes_dir = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_notifications.driver = [] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_notifications.retry = -1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] key_manager.fixed_key = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.barbican_api_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.barbican_endpoint = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.barbican_endpoint_type = public {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.barbican_region_name = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.cafile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.collect_timing = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.number_of_retries = 60 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.retry_delay = 1 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.send_service_user_token = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.split_loggers = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.tls_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.tls_min_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.verify_ssl = True {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican.verify_ssl_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.auth_section = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.auth_type = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.cafile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.certfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.collect_timing = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.insecure = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.keyfile = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.split_loggers = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.timeout = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.tls_ciphers = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] barbican_service_user.tls_min_version = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.approle_role_id = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.approle_secret_id = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.auth_method = approle {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.auth_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.kv_mountpoint = secret {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.kv_path = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.kv_version = 2 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.namespace = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.root_token_id = **** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.ssl_ca_crt_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.timeout = 60.0 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.token_file = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.token_role = None {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.use_ssl = False {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:59:39 devstack cinder-volume[87111]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd9943-7c47-4bea-9a6d-53d4c70234b8 None None] ******************************************************************************** {{(pid=87111) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:59:39 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.volume.driver [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.driver [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5200576782227, 'free_capacity_gb': 1773.5200576782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87367) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_db.sqlalchemy.engines [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writer thread running {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.db.api [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Building query based on filter {{(pid=87367) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87367) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.keymgr.migration [None req-6ee111e9-16a6-4b39-86d6-cdcce04b549d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:59:39 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:39 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:39 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.230s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Driver initialization completed successfully. Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Initiating service 3 cleanup Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Service 3 cleanup completed. Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.service [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Creating RPC server for service cinder-volume {{(pid=87367) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.service [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87367) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:59:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:39 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 18:59:39 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:40 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.229s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-401166cc-4290-4107-ba8f-971fcff7e433 None None] Driver post RPC initialization completed successfully. Nov 04 18:59:48 devstack cinder-volume[87111]: DEBUG dbcounter [-] [87111] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:49 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:00:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 6 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:00:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Flow 'volume_create_manager' (961fe604-595f-4112-8e95-282fe82caa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439c28fe-45b0-4a71-a8e5-0e0e3e3443fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439c28fe-45b0-4a71-a8e5-0e0e3e3443fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1097321099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387ed1ce-555e-4aa9-8147-9490ac248da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae46e83a62b4c34b87112b57e6d39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:38Z,use_quota=True,user_id='569b73a7e8034a8983270bbe25bc2a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcfc2f9-d18e-4983-9dcb-ca5f83d95075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcfc2f9-d18e-4983-9dcb-ca5f83d95075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f04ed2-622d-404b-a2b8-c0c88a1d552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62f04ed2-622d-404b-a2b8-c0c88a1d552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387ed1ce-555e-4aa9-8147-9490ac248da5', 'volume_name': 'volume-387ed1ce-555e-4aa9-8147-9490ac248da5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de47fa02-ca54-4b54-ad14-30ea0cfce8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de47fa02-ca54-4b54-ad14-30ea0cfce8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c829ba31-88f3-4459-94e0-1201362ae854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:38 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Volume 387ed1ce-555e-4aa9-8147-9490ac248da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387ed1ce-555e-4aa9-8147-9490ac248da5', 'volume_size': 1} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1097321099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387ed1ce-555e-4aa9-8147-9490ac248da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae46e83a62b4c34b87112b57e6d39c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:38Z,use_quota=True,user_id='569b73a7e8034a8983270bbe25bc2a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Creating volume 387ed1ce-555e-4aa9-8147-9490ac248da5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:38 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:00:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:38 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 1073741824 Nov 04 19:00:38 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 1073741824" returned: 0 in 0.852s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:39 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 Nov 04 19:00:39 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5" returned: 0 in 0.437s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c829ba31-88f3-4459-94e0-1201362ae854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387ed1ce-555e-4aa9-8147-9490ac248da5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738152e-57fc-429e-856e-c38ec736c63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Volume volume-387ed1ce-555e-4aa9-8147-9490ac248da5 (387ed1ce-555e-4aa9-8147-9490ac248da5): created successfully Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738152e-57fc-429e-856e-c38ec736c63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Flow 'volume_create_manager' (961fe604-595f-4112-8e95-282fe82caa23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-421978fd-f8e5-4a7e-91aa-9adfc746db57 tempest-TaggedAttachmentsTest-185127039 None] Created volume successfully. Nov 04 19:00:49 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Flow 'volume_create_manager' (3cf1eaae-2130-46d2-be33-ed1945598f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd8100e-34ce-4bf8-80ce-940d441c5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd8100e-34ce-4bf8-80ce-940d441c5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-67278321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9391a-8ba0-4eee-8a96-458750ee31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7afaab416594874babc83c517630132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:22Z,use_quota=True,user_id='698ba698fca1412890b0a2ab8ba466db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dc1f93-942c-4a71-ac90-9a4709270276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dc1f93-942c-4a71-ac90-9a4709270276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f469751-1170-40d2-8d45-62219debf2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f469751-1170-40d2-8d45-62219debf2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b9391a-8ba0-4eee-8a96-458750ee31c8', 'volume_name': 'volume-87b9391a-8ba0-4eee-8a96-458750ee31c8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b5ed5-91eb-4b76-a079-66f23171349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392b5ed5-91eb-4b76-a079-66f23171349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e7370e-29a6-4128-af91-69132e2b397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:22 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Volume 87b9391a-8ba0-4eee-8a96-458750ee31c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b9391a-8ba0-4eee-8a96-458750ee31c8', 'volume_size': 1} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-67278321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b9391a-8ba0-4eee-8a96-458750ee31c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7afaab416594874babc83c517630132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:22Z,use_quota=True,user_id='698ba698fca1412890b0a2ab8ba466db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Creating volume 87b9391a-8ba0-4eee-8a96-458750ee31c8 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:22 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:22 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 1073741824 Nov 04 19:01:22 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:22 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:01:22 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.755s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 6 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:01:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:01:23 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 1073741824" returned: 0 in 1.428s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:23 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 Nov 04 19:01:23 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:23 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e7370e-29a6-4128-af91-69132e2b397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b9391a-8ba0-4eee-8a96-458750ee31c8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b61ed60-b5eb-429e-98e4-85a00ce3d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Volume volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 (87b9391a-8ba0-4eee-8a96-458750ee31c8): created successfully Nov 04 19:01:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b61ed60-b5eb-429e-98e4-85a00ce3d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Flow 'volume_create_manager' (3cf1eaae-2130-46d2-be33-ed1945598f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3c936812-18f5-4d3e-8a83-de3d1d8c8b2d tempest-VolumesAdminNegativeTest-1217320907 None] Created volume successfully. Nov 04 19:01:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Acquiring lock "cinder-87b9391a-8ba0-4eee-8a96-458750ee31c8-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "cinder-87b9391a-8ba0-4eee-8a96-458750ee31c8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Acquiring lock "cinder-quobyte-87b9391a-8ba0-4eee-8a96-458750ee31c8" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "cinder-quobyte-87b9391a-8ba0-4eee-8a96-458750ee31c8" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:26 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzg8ixggx/privsep.sock'] Nov 04 19:01:26 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzg8ixggx/privsep.sock Nov 04 19:01:26 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 19:01:29 devstack cinder-volume[87367]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 19:01:29 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:29 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Spawned new privsep daemon via rootwrap Nov 04 19:01:29 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Accepted privsep connection to /tmp/tmpzg8ixggx/privsep.sock {{(pid=87367) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 19:01:29 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 19:01:29 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 19:01:29 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 19:01:29 devstack cinder-volume[87367]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88512 Nov 04 19:01:29 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb368b-09b5-4dae-84d6-81cf4de55d98]: (2,) {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:29 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[993657b3-f596-4b0a-b365-5d318fc6d930]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:29 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 Nov 04 19:01:29 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Flow 'volume_create_manager' (de9711ab-7056-4329-ad66-956ccde7cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f19745-fbef-41b0-8944-74e691df173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f19745-fbef-41b0-8944-74e691df173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1930373430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235030c-f4f5-4563-9e2b-8ec8b7627cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeec7e86d4e4083a905199a4791e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:30Z,use_quota=True,user_id='54eb834d11e94fef920c64820976c12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441adb12-2606-452d-ba87-558c663361d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441adb12-2606-452d-ba87-558c663361d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d7d2f-c149-4fc9-be42-bddf641a79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d7d2f-c149-4fc9-be42-bddf641a79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1235030c-f4f5-4563-9e2b-8ec8b7627cf5', 'volume_name': 'volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08dcb7f-814e-4bf6-be8c-02902220c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08dcb7f-814e-4bf6-be8c-02902220c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5afb184-1bf5-45a8-a277-5687accdaef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Volume 1235030c-f4f5-4563-9e2b-8ec8b7627cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5', 'volume_size': 1} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1930373430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235030c-f4f5-4563-9e2b-8ec8b7627cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aeec7e86d4e4083a905199a4791e7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:30Z,use_quota=True,user_id='54eb834d11e94fef920c64820976c12c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Creating volume 1235030c-f4f5-4563-9e2b-8ec8b7627cf5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:30 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8" returned: 0 in 0.733s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 1073741824 Nov 04 19:01:30 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:30 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8 Nov 04 19:01:30 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:31 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-87b9391a-8ba0-4eee-8a96-458750ee31c8" returned: 0 in 0.655s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "cinder-quobyte-87b9391a-8ba0-4eee-8a96-458750ee31c8" released by "delete_volume" :: held 4.518s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:31 devstack cinder-volume[87367]: WARNING cinder.quota [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:31 devstack cinder-volume[87367]: WARNING cinder.quota [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Created reservations ['4164a5e3-4d20-41e4-9a97-d375fd3c476b', 'ded75cd8-1046-4b0b-85ff-1d97f3cf283e', 'd22aec39-8d45-4e49-80f3-256d7c01940e', '4ec413c5-9e54-4100-9360-a972aecf7618'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:31 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 1073741824" returned: 0 in 1.091s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:31 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:01:31 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:31 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 Nov 04 19:01:31 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:32 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.468s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Deleted volume successfully. Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bd9597cb-da74-4ee6-bd33-49a946f7c0be tempest-VolumesAdminNegativeTest-1217320907 None] Lock "cinder-87b9391a-8ba0-4eee-8a96-458750ee31c8-delete_volume" released by "delete_volume" :: held 5.820s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:32 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" returned: 0 in 0.676s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5afb184-1bf5-45a8-a277-5687accdaef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8792e7-a599-450e-b5f3-c4da6c05c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:32 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Volume volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 (1235030c-f4f5-4563-9e2b-8ec8b7627cf5): created successfully Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8792e7-a599-450e-b5f3-c4da6c05c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Flow 'volume_create_manager' (de9711ab-7056-4329-ad66-956ccde7cb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-95498939-3168-4c52-aa1a-37c6f148a43c tempest-ServerRescueNegativeTestJSON-897507839 None] Created volume successfully. Nov 04 19:01:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=18,cinder:SELECT=8,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Acquiring lock "cinder-1235030c-f4f5-4563-9e2b-8ec8b7627cf5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "cinder-1235030c-f4f5-4563-9e2b-8ec8b7627cf5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Acquiring lock "cinder-quobyte-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "cinder-quobyte-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc425132-903c-4a5a-ac3f-478ac4418083]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:58 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 Nov 04 19:01:58 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" returned: 0 in 0.545s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:59 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:59 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5 Nov 04 19:01:59 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:59 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" returned: 0 in 0.419s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "cinder-quobyte-1235030c-f4f5-4563-9e2b-8ec8b7627cf5" released by "delete_volume" :: held 1.044s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Created reservations ['360bd33f-9f62-4ddb-99ba-25a4c5d49381', '396a53d5-5baa-451b-a02a-2e6aa9883d03', '05cc6760-c5b2-446c-909b-663e20fc7e48', '65d39a45-97c4-44a5-8aa0-5ae7e3cb9a8e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:59 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:01:59 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:00 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:00 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Deleted volume successfully. Nov 04 19:02:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14289f17-8f58-40fe-abd3-1c3ce0166fe6 tempest-ServerRescueNegativeTestJSON-897507839 None] Lock "cinder-1235030c-f4f5-4563-9e2b-8ec8b7627cf5-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:09 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:10 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:17 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Flow 'volume_create_manager' (7050f3c7-1cbf-4aef-8ada-4cb256699cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b6617-ef50-4110-bb62-253bfaf3b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378b6617-ef50-4110-bb62-253bfaf3b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-245747669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48f1b53-872e-4bd9-820f-83457a8c79bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccb62f8f696428cb7c491469dfad070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:18Z,use_quota=True,user_id='7224b7c7385c4c1187ed242cfed554fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a669e3-8ea4-48d5-9715-9e2b18dca7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a669e3-8ea4-48d5-9715-9e2b18dca7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da89d396-d636-4ffd-96e1-ee87af91ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da89d396-d636-4ffd-96e1-ee87af91ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48f1b53-872e-4bd9-820f-83457a8c79bd', 'volume_name': 'volume-d48f1b53-872e-4bd9-820f-83457a8c79bd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07804ad-b7dc-4729-8975-6a7840be3eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07804ad-b7dc-4729-8975-6a7840be3eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef2ac8a-1b89-4584-a3b4-c4033f6f1521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Volume d48f1b53-872e-4bd9-820f-83457a8c79bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48f1b53-872e-4bd9-820f-83457a8c79bd', 'volume_size': 1} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-245747669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48f1b53-872e-4bd9-820f-83457a8c79bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccb62f8f696428cb7c491469dfad070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:18Z,use_quota=True,user_id='7224b7c7385c4c1187ed242cfed554fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Creating volume d48f1b53-872e-4bd9-820f-83457a8c79bd {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:18 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:02:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd 1073741824 Nov 04 19:02:18 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:19 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd 1073741824" returned: 0 in 0.895s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd Nov 04 19:02:19 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:19 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd" returned: 0 in 0.466s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef2ac8a-1b89-4584-a3b4-c4033f6f1521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48f1b53-872e-4bd9-820f-83457a8c79bd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d433f1f-05ae-4892-b83c-923c2a7a8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Volume volume-d48f1b53-872e-4bd9-820f-83457a8c79bd (d48f1b53-872e-4bd9-820f-83457a8c79bd): created successfully Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d433f1f-05ae-4892-b83c-923c2a7a8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Flow 'volume_create_manager' (7050f3c7-1cbf-4aef-8ada-4cb256699cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3006b52d-cd77-4f50-8578-230fdbbd8510 tempest-DeleteServersTestJSON-993877746 None] Created volume successfully. Nov 04 19:02:19 devstack cinder-volume[87367]: WARNING py.warnings [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 04 19:02:19 devstack cinder-volume[87367]: .first() Nov 04 19:02:19 devstack cinder-volume[87367]: Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-387ed1ce-555e-4aa9-8147-9490ac248da5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfdbfcb9-4611-426f-98c0-d18bbd996401', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:02:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-e95e4b90-5cbb-4be0-8180-6be05d1621cc req-33abbd80-0d34-4507-8d1d-fcc2c056b92b tempest-TaggedAttachmentsTest-185127039 None] attachment_update completed successfully. Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:22 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:02:22 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:22 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 8 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:02:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:02:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2a5212e5-77e0-47a4-b04b-3796316de7bf req-161ba0d1-4ae5-4b5d-8e14-3b52ab340c6c tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2a5212e5-77e0-47a4-b04b-3796316de7bf req-161ba0d1-4ae5-4b5d-8e14-3b52ab340c6c tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2a5212e5-77e0-47a4-b04b-3796316de7bf req-161ba0d1-4ae5-4b5d-8e14-3b52ab340c6c tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-2a5212e5-77e0-47a4-b04b-3796316de7bf req-161ba0d1-4ae5-4b5d-8e14-3b52ab340c6c tempest-DeleteServersTestJSON-993877746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-d48f1b53-872e-4bd9-820f-83457a8c79bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05b8157d-b79d-4008-a099-334373538ecd', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:02:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-2a5212e5-77e0-47a4-b04b-3796316de7bf req-161ba0d1-4ae5-4b5d-8e14-3b52ab340c6c tempest-DeleteServersTestJSON-993877746 None] attachment_update completed successfully. Nov 04 19:02:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-d0637ee8-8aac-4b1a-8351-ff72f598aa6d req-11fd2294-e30c-44c4-9003-081e916e382b tempest-TaggedAttachmentsTest-185127039 None] Terminate volume connection completed successfully. Nov 04 19:02:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-d0637ee8-8aac-4b1a-8351-ff72f598aa6d req-11fd2294-e30c-44c4-9003-081e916e382b tempest-TaggedAttachmentsTest-185127039 None] Deleting attachment dfdbfcb9-4611-426f-98c0-d18bbd996401. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:02:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-4dec7948-db2c-44b3-935e-c0b32c3e60b2 req-515b8a11-5571-48e6-a588-610de079ff84 tempest-DeleteServersTestJSON-993877746 None] Terminate volume connection completed successfully. Nov 04 19:02:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-4dec7948-db2c-44b3-935e-c0b32c3e60b2 req-515b8a11-5571-48e6-a588-610de079ff84 tempest-DeleteServersTestJSON-993877746 None] Deleting attachment 05b8157d-b79d-4008-a099-334373538ecd. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "cinder-d48f1b53-872e-4bd9-820f-83457a8c79bd-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "cinder-d48f1b53-872e-4bd9-820f-83457a8c79bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "cinder-quobyte-d48f1b53-872e-4bd9-820f-83457a8c79bd" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "cinder-quobyte-d48f1b53-872e-4bd9-820f-83457a8c79bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8bb4f-050f-473b-97d0-577a8425aa0b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:35 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd Nov 04 19:02:35 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:36 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd" returned: 0 in 0.733s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:36 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd Nov 04 19:02:36 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:36 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d48f1b53-872e-4bd9-820f-83457a8c79bd" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "cinder-quobyte-d48f1b53-872e-4bd9-820f-83457a8c79bd" released by "delete_volume" :: held 1.219s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Created reservations ['1f765636-5f9b-401f-b60a-69469e3f42fd', 'd0663340-4b1c-4173-8138-588e40fb9246', '0e1cfcbb-636a-440b-a975-b6ed7f3b9f50', '9f8444c6-7d17-4d8a-aeb5-f963285d336d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:36 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:02:36 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:37 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.380s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:37 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:37 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Deleted volume successfully. Nov 04 19:02:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1387fb5-f3a7-4a9e-b921-fad04524d47e tempest-DeleteServersTestJSON-993877746 None] Lock "cinder-d48f1b53-872e-4bd9-820f-83457a8c79bd-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:46 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=18,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "cinder-387ed1ce-555e-4aa9-8147-9490ac248da5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "cinder-387ed1ce-555e-4aa9-8147-9490ac248da5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "cinder-quobyte-387ed1ce-555e-4aa9-8147-9490ac248da5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "cinder-quobyte-387ed1ce-555e-4aa9-8147-9490ac248da5" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d1bc30-2549-4750-9ebc-9084b00828df]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:47 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 Nov 04 19:02:47 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:48 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5" returned: 0 in 0.447s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:48 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5 Nov 04 19:02:48 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:48 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387ed1ce-555e-4aa9-8147-9490ac248da5" returned: 0 in 0.338s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "cinder-quobyte-387ed1ce-555e-4aa9-8147-9490ac248da5" released by "delete_volume" :: held 0.854s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Created reservations ['8f73d7f8-a4c8-4000-a3e1-8f920e48ad50', '1e51cdd3-5402-4f61-bae3-ab9665d58133', 'd6d71f39-9f3d-445c-93b4-926fc1f50340', '1a19c867-696d-4689-abae-81be19c3ee2c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:48 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:02:48 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:49 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.340s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:49 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Deleted volume successfully. Nov 04 19:02:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3255294c-9215-4436-8426-33c1b05483f2 tempest-TaggedAttachmentsTest-185127039 None] Lock "cinder-387ed1ce-555e-4aa9-8147-9490ac248da5-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Flow 'volume_create_manager' (68d734c7-4377-4477-b0b8-dbe582019dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efecc4d-55ad-4b90-b722-dc7b9330c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efecc4d-55ad-4b90-b722-dc7b9330c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-94569605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c1a299-03fa-450e-92ef-bbdde9431045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7294de96933459d9ebab04fb131dd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:55Z,use_quota=True,user_id='87ad0db7396243ba9491167d26442adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda26a6e-9a41-4492-a8e9-2ae6a824c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda26a6e-9a41-4492-a8e9-2ae6a824c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b1692-5740-48e1-ae6f-0f713fb2e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b1692-5740-48e1-ae6f-0f713fb2e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c1a299-03fa-450e-92ef-bbdde9431045', 'volume_name': 'volume-b0c1a299-03fa-450e-92ef-bbdde9431045', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed20dc4a-5431-4eec-9d03-3a0f30f181da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed20dc4a-5431-4eec-9d03-3a0f30f181da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68965c4-0cf0-4b9f-8675-31079f1d1963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Volume b0c1a299-03fa-450e-92ef-bbdde9431045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c1a299-03fa-450e-92ef-bbdde9431045', 'volume_size': 1} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-94569605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c1a299-03fa-450e-92ef-bbdde9431045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7294de96933459d9ebab04fb131dd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:55Z,use_quota=True,user_id='87ad0db7396243ba9491167d26442adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Creating volume b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:55 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:02:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:55 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 1073741824 Nov 04 19:02:55 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:56 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 1073741824" returned: 0 in 0.716s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:56 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 Nov 04 19:02:56 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:56 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68965c4-0cf0-4b9f-8675-31079f1d1963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c1a299-03fa-450e-92ef-bbdde9431045', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2254f77-81f4-49d6-b2c6-d964fa53aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Volume volume-b0c1a299-03fa-450e-92ef-bbdde9431045 (b0c1a299-03fa-450e-92ef-bbdde9431045): created successfully Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2254f77-81f4-49d6-b2c6-d964fa53aecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Flow 'volume_create_manager' (68d734c7-4377-4477-b0b8-dbe582019dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-553239b9-f73d-4eb3-8071-1f407eb3c6bb req-54c1c51f-f380-4d75-a52a-951527dbfce8 tempest-VolumesSnapshotsTestJSON-1638041224 None] Created volume successfully. Nov 04 19:02:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Creating offline snapshot 5243631e-00e3-4347-b8f4-3ef35fe63119 of volume b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:02:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b40cbf-4eb3-46f4-ac80-3e11d3baba0a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:58 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 Nov 04 19:02:58 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:59 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045" returned: 0 in 0.556s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:59 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 1G Nov 04 19:02:59 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:00 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 1G" returned: 0 in 0.777s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c1a299-03fa-450e-92ef-bbdde9431045 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:00 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c1a299-03fa-450e-92ef-bbdde9431045 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 Nov 04 19:03:00 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:00 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c1a299-03fa-450e-92ef-bbdde9431045 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119" returned: 0 in 0.758s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:00 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 is being set with open permissions: ugo+rw Nov 04 19:03:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:00 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 Nov 04 19:03:00 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:01 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119" returned: 0 in 0.611s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:01 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info Nov 04 19:03:01 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:01 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info" returned: 0 in 0.520s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:02 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info is being set with open permissions: ugo+rw Nov 04 19:03:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:02 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info Nov 04 19:03:02 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:02 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.info" returned: 0 in 0.781s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.300s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-fdbf14a6-506c-41d6-b528-722598879550 req-abc09a7d-aa48-4fad-8456-5b44dc388e57 tempest-VolumesSnapshotsTestJSON-1638041224 None] Create snapshot completed successfully Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "cinder-5243631e-00e3-4347-b8f4-3ef35fe63119-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-5243631e-00e3-4347-b8f4-3ef35fe63119-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "cinder-quobyte-5243631e-00e3-4347-b8f4-3ef35fe63119" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-5243631e-00e3-4347-b8f4-3ef35fe63119" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Deleting offline snapshot 5243631e-00e3-4347-b8f4-3ef35fe63119 of volume b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] snapshot_file for this snap is: volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f723b62-8f29-4585-9e67-cec16bef472e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:03 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 Nov 04 19:03:03 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119" returned: 0 in 0.551s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0c1a299-03fa-450e-92ef-bbdde9431045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c322879-3242-479a-9a1a-9e8d5b46c535]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 Nov 04 19:03:04 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045" returned: 0 in 0.591s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 Nov 04 19:03:05 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119" returned: 0 in 0.733s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119 Nov 04 19:03:05 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045.5243631e-00e3-4347-b8f4-3ef35fe63119" returned: 0 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-5243631e-00e3-4347-b8f4-3ef35fe63119" released by "_delete_snapshot" :: held 2.386s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" released by "delete_snapshot" :: held 2.465s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack cinder-volume[87367]: WARNING cinder.quota [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:03:06 devstack cinder-volume[87367]: DEBUG cinder.quota [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Created reservations ['927194e8-0191-4145-934d-ccde50c58eb0', 'a5313513-e26b-47b1-911a-9a11099cb01d', 'd1129735-84df-49ab-ac51-0bb4bf35e3c6', '2f942d70-d5f9-457e-8dc9-75b61de21097'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Delete snapshot completed successfully. Nov 04 19:03:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-f3d43e05-2e7b-4dad-af35-2f991fec42cb req-cf583a90-7490-4bbd-b3b7-f6b1f48c8cb5 tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-5243631e-00e3-4347-b8f4-3ef35fe63119-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "cinder-b0c1a299-03fa-450e-92ef-bbdde9431045-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-b0c1a299-03fa-450e-92ef-bbdde9431045-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd476bed-6294-4d98-92b4-5cd5d031eccb]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 Nov 04 19:03:08 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:08 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045" returned: 0 in 0.607s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045 Nov 04 19:03:08 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:08 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b0c1a299-03fa-450e-92ef-bbdde9431045" returned: 0 in 0.346s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-quobyte-b0c1a299-03fa-450e-92ef-bbdde9431045" released by "delete_volume" :: held 1.085s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG cinder.quota [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Created reservations ['e9a76363-9b59-416f-8c87-67f65810ecf6', '9ba777ff-5be8-4419-9245-a5c1cc607415', 'f4bf3725-6fa8-47a4-863f-f4b23793033b', 'b74976e4-03a8-47f1-948f-78a6374ca7bf'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:03:09 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.326s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG cinder.manager [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Deleted volume successfully. Nov 04 19:03:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-b0a86ad4-8d22-43c7-a6ab-9648c8ad4b41 req-4c46cf60-b7bc-450f-8b9c-4f6c51cbaf4f tempest-VolumesSnapshotsTestJSON-1638041224 None] Lock "cinder-b0c1a299-03fa-450e-92ef-bbdde9431045-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Flow 'volume_create_manager' (556400d3-6002-4bb4-95f5-9d1dee918a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2696e4b-67de-4729-9564-9843bad92a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2696e4b-67de-4729-9564-9843bad92a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1315562507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d221bd-49aa-4041-ae24-ce0b9c4b10bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba81e52fc224dc49fb0086ff53d4afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:20Z,use_quota=True,user_id='8a255b2264d8478391176f5309b662c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759e7cda-38b5-4a55-9dbf-379a90cb6dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759e7cda-38b5-4a55-9dbf-379a90cb6dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35e3f02-803c-43e3-a378-a4bc8881d2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35e3f02-803c-43e3-a378-a4bc8881d2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'volume_name': 'volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ac7a5-dbb7-45d5-8dd1-370a8c58ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ac7a5-dbb7-45d5-8dd1-370a8c58ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bf427d-7ffd-4b95-966f-87e86eaa78f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Volume 04d221bd-49aa-4041-ae24-ce0b9c4b10bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'volume_size': 1} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1315562507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d221bd-49aa-4041-ae24-ce0b9c4b10bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba81e52fc224dc49fb0086ff53d4afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:20Z,use_quota=True,user_id='8a255b2264d8478391176f5309b662c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Creating volume 04d221bd-49aa-4041-ae24-ce0b9c4b10bd {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:19 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:03:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:19 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd 1073741824 Nov 04 19:03:19 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd 1073741824" returned: 0 in 0.691s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd Nov 04 19:03:20 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:21 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bf427d-7ffd-4b95-966f-87e86eaa78f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5bc568-3cb9-4e57-b3ad-29cf8797e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Volume volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd (04d221bd-49aa-4041-ae24-ce0b9c4b10bd): created successfully Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5bc568-3cb9-4e57-b3ad-29cf8797e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Flow 'volume_create_manager' (556400d3-6002-4bb4-95f5-9d1dee918a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0e20b9d6-f818-450f-93e4-fa2f188522dd tempest-ServerActionsTestOtherA-1950031439 None] Created volume successfully. Nov 04 19:03:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0db8be07-7885-431f-86af-4fc521a46258 tempest-GroupsV314Test-1193081075 None] Group tempest-GroupsV314Test-Group-1411492947: creating Nov 04 19:03:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0db8be07-7885-431f-86af-4fc521a46258 tempest-GroupsV314Test-1193081075 None] Group tempest-GroupsV314Test-Group-1411492947: created successfully Nov 04 19:03:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0db8be07-7885-431f-86af-4fc521a46258 tempest-GroupsV314Test-1193081075 None] Create group completed successfully. Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:22 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:03:22 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:22 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.301s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Flow 'volume_create_manager' (f3426781-6328-4680-9408-3f4e2eea3ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e7212-5ae1-405d-9a26-c7de81f1502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e7212-5ae1-405d-9a26-c7de81f1502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214638019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc91f368-4e3d-4de8-9034-18ba7e87b173,host='devstack@QuobyteHD#QuobyteHD',id=0386c3f6-d48b-4447-bae8-29b4be759a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe89c547f0e4cc9b8b186eb0c8e0431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:24Z,use_quota=True,user_id='9eb3dd6359b74a828ac542e6760d5cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfc687a7-c076-472e-84de-39d019381a49),volume_type_id=dfc687a7-c076-472e-84de-39d019381a49)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8663815c-2de5-4d05-b64c-1abf9afe59ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8663815c-2de5-4d05-b64c-1abf9afe59ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e588104-6e07-4611-be9e-9b7725d5a23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e588104-6e07-4611-be9e-9b7725d5a23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0386c3f6-d48b-4447-bae8-29b4be759a45', 'volume_name': 'volume-0386c3f6-d48b-4447-bae8-29b4be759a45', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0147de05-39ff-4b59-8967-51bd05fd9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0147de05-39ff-4b59-8967-51bd05fd9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac97b614-c821-4bcf-ac53-33ee71e6910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Volume 0386c3f6-d48b-4447-bae8-29b4be759a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0386c3f6-d48b-4447-bae8-29b4be759a45', 'volume_size': 1} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bc91f368-4e3d-4de8-9034-18ba7e87b173,created_at=2026-11-04T18:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214638019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc91f368-4e3d-4de8-9034-18ba7e87b173,host='devstack@QuobyteHD#QuobyteHD',id=0386c3f6-d48b-4447-bae8-29b4be759a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe89c547f0e4cc9b8b186eb0c8e0431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:24Z,use_quota=True,user_id='9eb3dd6359b74a828ac542e6760d5cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfc687a7-c076-472e-84de-39d019381a49),volume_type_id=dfc687a7-c076-472e-84de-39d019381a49)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Creating volume 0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:23 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:03:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 1073741824 Nov 04 19:03:23 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 1073741824" returned: 0 in 0.725s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:24 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.377s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac97b614-c821-4bcf-ac53-33ee71e6910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0386c3f6-d48b-4447-bae8-29b4be759a45', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a00c327-f86b-4de7-841c-dee013fe6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Volume volume-0386c3f6-d48b-4447-bae8-29b4be759a45 (0386c3f6-d48b-4447-bae8-29b4be759a45): created successfully Nov 04 19:03:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a00c327-f86b-4de7-841c-dee013fe6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Flow 'volume_create_manager' (f3426781-6328-4680-9408-3f4e2eea3ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a83fe843-db78-4d35-8b06-018e6a38821c tempest-GroupsV314Test-1193081075 None] Created volume successfully. Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:27 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Cloning volume 0386c3f6-d48b-4447-bae8-29b4be759a45 to volume 2a66ad40-32ce-4101-b1be-03da5586150c Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Creating offline snapshot ca31a448-f826-4407-8d8b-094cbec4959b of volume 0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc49b7-4da1-42a8-a29f-77633bbb7023]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:27 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.522s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b 1G Nov 04 19:03:27 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (03d9982e-9059-4e12-8ba3-6d32c3ae3bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49227f86-85b6-4add-b933-24cb8b0d0990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49227f86-85b6-4add-b933-24cb8b0d0990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847132693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d44b73f-aef9-48ba-9988-544e4bd46bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:28Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4614a25-6261-488d-8501-dccd4629f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4614a25-6261-488d-8501-dccd4629f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e177088-1adb-4ace-a859-cbb25ba4eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e177088-1adb-4ace-a859-cbb25ba4eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d44b73f-aef9-48ba-9988-544e4bd46bb6', 'volume_name': 'volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed61110c-3b06-4f80-923b-74085f635807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed61110c-3b06-4f80-923b-74085f635807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28af07a5-0114-4560-b263-4b99b426630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Volume 6d44b73f-aef9-48ba-9988-544e4bd46bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6', 'volume_size': 1} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:28 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b 1G" returned: 0 in 0.779s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0386c3f6-d48b-4447-bae8-29b4be759a45 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:28 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0386c3f6-d48b-4447-bae8-29b4be759a45 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:28 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:29 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0386c3f6-d48b-4447-bae8-29b4be759a45 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.564s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:29 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:03:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:29 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:29 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:29 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.453s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:29 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info Nov 04 19:03:29 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:30 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:30 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info Nov 04 19:03:30 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.info" returned: 0 in 0.343s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Acquiring lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] snapshot: ca31a448-f826-4407-8d8b-094cbec4959b, volume: 2a66ad40-32ce-4101-b1be-03da5586150c, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecf39bf-cf7a-42f0-a918-75b810e139c3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:30 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:30 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:31 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.512s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0386c3f6-d48b-4447-bae8-29b4be759a45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[70476aed-9a3f-4e49-862b-4094c18057dc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:31 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:31 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:31 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.567s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:03:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:31 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c Nov 04 19:03:31 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:39 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:39 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:48 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c" returned: 0 in 16.731s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:48 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45, size 1024.00 MB, duration 16.73 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:03:48 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Converted 1024.00 MB image at 61.20 MB/s Nov 04 19:03:48 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:03:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:48 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c Nov 04 19:03:48 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:49 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c" returned: 0 in 0.701s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" released by "_copy_volume_from_snapshot" :: held 18.628s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Acquiring lock "cinder-quobyte-ca31a448-f826-4407-8d8b-094cbec4959b" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-ca31a448-f826-4407-8d8b-094cbec4959b" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Deleting offline snapshot ca31a448-f826-4407-8d8b-094cbec4959b of volume 0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] snapshot_file for this snap is: volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cee764d-c25b-46a2-87c3-212e9175f2f0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:49 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:49 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:50 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.850s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0386c3f6-d48b-4447-bae8-29b4be759a45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:50 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bafaa00-969d-4f49-8933-468ab10f297c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:50 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:50 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:51 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.797s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:51 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:51 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:51 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.529s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:51 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b Nov 04 19:03:51 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:51 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45.ca31a448-f826-4407-8d8b-094cbec4959b" returned: 0 in 0.299s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-ca31a448-f826-4407-8d8b-094cbec4959b" released by "_delete_snapshot" :: held 2.664s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.763s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.405s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-847132693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d44b73f-aef9-48ba-9988-544e4bd46bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:28Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Creating volume 6d44b73f-aef9-48ba-9988-544e4bd46bb6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:51 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:03:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:52 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 1073741824 Nov 04 19:03:52 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-021f0de5-0128-4b03-a594-3deb05db94ef tempest-GroupsV314Test-1193081075 None] Create group from source-group-bc91f368-4e3d-4de8-9034-18ba7e87b173 completed successfully. Nov 04 19:03:52 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 1073741824" returned: 0 in 0.769s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:52 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 Nov 04 19:03:52 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28af07a5-0114-4560-b263-4b99b426630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd8a1d4-a992-4112-8980-f223cfff57b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Volume volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 (6d44b73f-aef9-48ba-9988-544e4bd46bb6): created successfully Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd8a1d4-a992-4112-8980-f223cfff57b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (03d9982e-9059-4e12-8ba3-6d32c3ae3bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cf621719-51b9-4caf-9034-33ae8df3cd8e tempest-AttachVolumeNegativeTest-624908136 None] Created volume successfully. Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Acquiring lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" acquired by "delete_volume" :: waited 0.056s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[89012a53-b836-4f57-b24d-bc35496f6e70]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:54 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c Nov 04 19:03:54 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:54 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c" returned: 0 in 1.198s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:54 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c Nov 04 19:03:54 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:55 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2a66ad40-32ce-4101-b1be-03da5586150c" returned: 0 in 0.675s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-2a66ad40-32ce-4101-b1be-03da5586150c" released by "delete_volume" :: held 2.012s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-6cd28169-38aa-4f66-9e3e-093a6e501f01 req-23195ea4-db37-4db8-ab20-b16cf36f3c83 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-6cd28169-38aa-4f66-9e3e-093a6e501f01 req-23195ea4-db37-4db8-ab20-b16cf36f3c83 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Created reservations ['13aac6d8-9739-4842-8d94-7c466ce81d48'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-6cd28169-38aa-4f66-9e3e-093a6e501f01 req-23195ea4-db37-4db8-ab20-b16cf36f3c83 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.077s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:56 devstack cinder-volume[87367]: WARNING cinder.quota [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1441571843 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1441571843, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:03:56 devstack cinder-volume[87367]: WARNING cinder.quota [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1441571843 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1441571843, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-6cd28169-38aa-4f66-9e3e-093a6e501f01 req-23195ea4-db37-4db8-ab20-b16cf36f3c83 tempest-AttachVolumeNegativeTest-624908136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b409c0e-cac5-483c-80f4-257f5c70a445', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Created reservations ['24b01a2a-bc56-4151-9083-f48029cc623f', 'ce4c3d67-5221-4966-be46-1cec3c313381', 'f708542b-1e68-4237-a158-141fdabfa1f0', '907b02d1-946c-4d04-b7a3-57e55f5b3b95'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-6cd28169-38aa-4f66-9e3e-093a6e501f01 req-23195ea4-db37-4db8-ab20-b16cf36f3c83 tempest-AttachVolumeNegativeTest-624908136 None] attachment_update completed successfully. Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:56 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:03:56 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:56 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.596s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Acquiring lock "cinder-quobyte-0386c3f6-d48b-4447-bae8-29b4be759a45" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-da3266fc-b796-4c38-b78e-39a203bda153 tempest-GroupsV314Test-1193081075 None] Delete group completed successfully. Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-0386c3f6-d48b-4447-bae8-29b4be759a45" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[addcbba6-5cc6-4a4f-b81f-5e199bf1bd2d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:57 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:57 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:57 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.845s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:58 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45 Nov 04 19:03:58 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:58 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0386c3f6-d48b-4447-bae8-29b4be759a45" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Lock "cinder-quobyte-0386c3f6-d48b-4447-bae8-29b4be759a45" released by "delete_volume" :: held 1.379s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Created reservations ['51cf2c23-5d54-4c0d-b0cb-d6ef9e3619a0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Created reservations ['d46dd44a-3c22-4e14-b9ff-6fa9504d29c4', '744e17a4-df99-4349-b7d9-dd2506ec16eb', '93271f52-48bd-462d-89ab-ddef8e27a942', 'a771e95c-0c63-4884-8f95-7eead26f29d6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:58 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:03:58 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:59 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:59 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6020ac78-3288-4958-96fb-3bde5ffb5bc6 tempest-GroupsV314Test-1193081075 None] Delete group completed successfully. Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Flow 'volume_create_manager' (99f08279-609a-4bd0-b604-61f5145770b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17495e4-49bf-47ef-92e3-262c5d7b528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17495e4-49bf-47ef-92e3-262c5d7b528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1425948419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fce7da-a52d-4ebb-8033-df8e539abcfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a8eb732ba4120b42b8ca221d0251e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:02Z,use_quota=True,user_id='bc731cc5cc35446898b3a56278f5b406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea0731-da31-4fa5-80af-db81813f01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaea0731-da31-4fa5-80af-db81813f01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b2c3ed-2ff1-455f-9af2-5d7c16a52dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b2c3ed-2ff1-455f-9af2-5d7c16a52dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fce7da-a52d-4ebb-8033-df8e539abcfb', 'volume_name': 'volume-84fce7da-a52d-4ebb-8033-df8e539abcfb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d646d5a-6eba-49cb-ac3c-8aaa79ac089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d646d5a-6eba-49cb-ac3c-8aaa79ac089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808d482-98fc-40ad-bc61-ce5b5f323b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Volume 84fce7da-a52d-4ebb-8033-df8e539abcfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fce7da-a52d-4ebb-8033-df8e539abcfb', 'volume_size': 1} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1425948419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fce7da-a52d-4ebb-8033-df8e539abcfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a8eb732ba4120b42b8ca221d0251e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:02Z,use_quota=True,user_id='bc731cc5cc35446898b3a56278f5b406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Creating volume 84fce7da-a52d-4ebb-8033-df8e539abcfb {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:01 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:04:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:01 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb 1073741824 Nov 04 19:04:01 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb 1073741824" returned: 0 in 0.695s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:02 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb Nov 04 19:04:02 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb" returned: 0 in 0.408s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d808d482-98fc-40ad-bc61-ce5b5f323b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fce7da-a52d-4ebb-8033-df8e539abcfb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7144e1-1c33-4498-b1b3-ab1a7bf73748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:03 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Volume volume-84fce7da-a52d-4ebb-8033-df8e539abcfb (84fce7da-a52d-4ebb-8033-df8e539abcfb): created successfully Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7144e1-1c33-4498-b1b3-ab1a7bf73748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Flow 'volume_create_manager' (99f08279-609a-4bd0-b604-61f5145770b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7aae2c44-3c98-41f9-a84f-23177f621099 tempest-ServersNegativeTestJSON-847663458 None] Created volume successfully. Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Flow 'volume_create_manager' (42a924fd-4407-448b-b3cf-3bf4cbb2b651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dc0227-fb2b-4fa4-a053-3553c7d5dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dc0227-fb2b-4fa4-a053-3553c7d5dfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2059627656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d21fce-c586-43c7-b018-8a2cdbbc0009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a8eb732ba4120b42b8ca221d0251e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:06Z,use_quota=True,user_id='bc731cc5cc35446898b3a56278f5b406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c295b1c-bc37-41d3-85d0-5f90039dec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c295b1c-bc37-41d3-85d0-5f90039dec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de407ae5-e9f5-45b6-a039-c13776c48b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de407ae5-e9f5-45b6-a039-c13776c48b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d21fce-c586-43c7-b018-8a2cdbbc0009', 'volume_name': 'volume-46d21fce-c586-43c7-b018-8a2cdbbc0009', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63350e-95cf-406a-bc12-ac516e788ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b63350e-95cf-406a-bc12-ac516e788ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b16034-051e-4e5e-b388-466533d40c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Volume 46d21fce-c586-43c7-b018-8a2cdbbc0009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d21fce-c586-43c7-b018-8a2cdbbc0009', 'volume_size': 1} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2059627656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d21fce-c586-43c7-b018-8a2cdbbc0009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3a8eb732ba4120b42b8ca221d0251e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:06Z,use_quota=True,user_id='bc731cc5cc35446898b3a56278f5b406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Creating volume 46d21fce-c586-43c7-b018-8a2cdbbc0009 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:06 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 1073741824 Nov 04 19:04:06 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 1073741824" returned: 0 in 0.629s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 Nov 04 19:04:06 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009" returned: 0 in 0.284s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b16034-051e-4e5e-b388-466533d40c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d21fce-c586-43c7-b018-8a2cdbbc0009', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a93d814-d2d4-494d-890a-16a0136ecd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Volume volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 (46d21fce-c586-43c7-b018-8a2cdbbc0009): created successfully Nov 04 19:04:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a93d814-d2d4-494d-890a-16a0136ecd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Flow 'volume_create_manager' (42a924fd-4407-448b-b3cf-3bf4cbb2b651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7c50eb45-98bf-4697-b5ff-5cfb7e02e02c tempest-ServersNegativeTestJSON-847663458 None] Created volume successfully. Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Flow 'volume_create_manager' (81a2e8b4-6cb1-4f57-930d-85ff06038af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f441865c-adad-4d22-8d2e-70d64b591a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f441865c-adad-4d22-8d2e-70d64b591a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1245695767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae0b46c-a178-4ac4-a7dd-2e137a1c7977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8b1258ab9a45c9805bad3ccaeb4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:08Z,use_quota=True,user_id='5c55f4a1c7c845d2a0ee85221155b4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5634c00-8138-4a64-9787-fda02feed403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5634c00-8138-4a64-9787-fda02feed403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aead0bcb-2b38-4e34-b652-0c2953eb44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aead0bcb-2b38-4e34-b652-0c2953eb44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae0b46c-a178-4ac4-a7dd-2e137a1c7977', 'volume_name': 'volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e85567-c735-4271-80b7-075bbc4ea6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e85567-c735-4271-80b7-075bbc4ea6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1436706-f6dd-414e-be26-54f935df907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977', 'volume_size': 1} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1245695767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae0b46c-a178-4ac4-a7dd-2e137a1c7977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d8b1258ab9a45c9805bad3ccaeb4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:08Z,use_quota=True,user_id='5c55f4a1c7c845d2a0ee85221155b4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Creating volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "cinder-46d21fce-c586-43c7-b018-8a2cdbbc0009-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:08 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 1073741824 Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-46d21fce-c586-43c7-b018-8a2cdbbc0009-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:08 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "cinder-quobyte-46d21fce-c586-43c7-b018-8a2cdbbc0009" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-quobyte-46d21fce-c586-43c7-b018-8a2cdbbc0009" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e46fc-c3a4-4ce6-95f1-f98ae24c82a3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 Nov 04 19:04:09 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 1073741824" returned: 0 in 0.888s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009" returned: 0 in 0.735s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 Nov 04 19:04:09 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009 Nov 04 19:04:09 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46d21fce-c586-43c7-b018-8a2cdbbc0009" returned: 0 in 0.388s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-quobyte-46d21fce-c586-43c7-b018-8a2cdbbc0009" released by "delete_volume" :: held 1.243s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:10 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1436706-f6dd-414e-be26-54f935df907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ed2a7b-6bc6-4963-bba4-b87c76795718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Volume volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 (dae0b46c-a178-4ac4-a7dd-2e137a1c7977): created successfully Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ed2a7b-6bc6-4963-bba4-b87c76795718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Flow 'volume_create_manager' (81a2e8b4-6cb1-4f57-930d-85ff06038af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f2f713d0-8108-4b8c-8bce-6f47c442ba45 tempest-SnapshotsActionsTest-1531793218 None] Created volume successfully. Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Created reservations ['3c3667ba-1473-47e0-8743-a17953738d8b', 'd66a06c7-bb5a-4960-8ebc-fce6930c1869', '121ec20f-d676-424c-b69e-b60923532e17', '412ddae9-370f-46c4-b462-5e6b06e424e7'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:04:10 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Creating offline snapshot 8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cea4c1-7fc9-4da3-839a-9afd65b86d6f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "cinder-84fce7da-a52d-4ebb-8033-df8e539abcfb-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-84fce7da-a52d-4ebb-8033-df8e539abcfb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:11 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.783s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Deleted volume successfully. Nov 04 19:04:11 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 Nov 04 19:04:11 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "cinder-quobyte-84fce7da-a52d-4ebb-8033-df8e539abcfb" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-722f99c0-30db-4681-adf4-26658e02a6e5 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-46d21fce-c586-43c7-b018-8a2cdbbc0009-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-quobyte-84fce7da-a52d-4ebb-8033-df8e539abcfb" acquired by "delete_volume" :: waited 0.064s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a6849-3168-4649-bf5e-f5044579043c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:11 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb Nov 04 19:04:11 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:11 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" returned: 0 in 0.715s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:11 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f 1G Nov 04 19:04:11 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb" returned: 0 in 0.844s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb Nov 04 19:04:12 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e33b09c5-a051-465d-ba57-1f3006e11f99 req-f1fa9823-bb3e-428c-a7ad-ebef08abe731 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:12 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f 1G" returned: 0 in 0.764s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:12 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84fce7da-a52d-4ebb-8033-df8e539abcfb" returned: 0 in 0.419s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-quobyte-84fce7da-a52d-4ebb-8033-df8e539abcfb" released by "delete_volume" :: held 1.347s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Created reservations ['20197d40-6c82-45c8-9c1f-5fdffef173a8', 'd97ddd69-be22-4ae1-8f8a-7910328ba5d1', 'e5649fd4-ec7b-4fd1-a411-a33b38f2f42d', '0ca20992-9b1c-4007-a3b0-c959b6be0ebe'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:04:12 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.453s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f is being set with open permissions: ugo+rw Nov 04 19:04:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:12 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:13 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.406s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:13 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.307s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Deleted volume successfully. Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a50d8a4-77b7-486c-8a3e-aae5d360a797 tempest-ServersNegativeTestJSON-847663458 None] Lock "cinder-84fce7da-a52d-4ebb-8033-df8e539abcfb-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:13 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info Nov 04 19:04:13 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:13 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info" returned: 0 in 0.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:13 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info is being set with open permissions: ugo+rw Nov 04 19:04:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:13 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info Nov 04 19:04:13 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:14 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.info" returned: 0 in 0.479s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.257s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e33b09c5-a051-465d-ba57-1f3006e11f99 req-f1fa9823-bb3e-428c-a7ad-ebef08abe731 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.968s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e33b09c5-a051-465d-ba57-1f3006e11f99 req-f1fa9823-bb3e-428c-a7ad-ebef08abe731 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-24b08bd1-7864-428b-a85c-b0832feab29c tempest-SnapshotsActionsTest-1531793218 None] Create snapshot completed successfully Nov 04 19:04:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-e33b09c5-a051-465d-ba57-1f3006e11f99 req-f1fa9823-bb3e-428c-a7ad-ebef08abe731 tempest-ServerActionsTestOtherA-1950031439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22f3d6bf-1d6c-4b68-8a5d-57705f571811', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:04:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-e33b09c5-a051-465d-ba57-1f3006e11f99 req-f1fa9823-bb3e-428c-a7ad-ebef08abe731 tempest-ServerActionsTestOtherA-1950031439 None] attachment_update completed successfully. Nov 04 19:04:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Creating offline snapshot 9dff423d-9123-4f0a-848e-a2ef0299ccce of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafaf844-0552-4204-9ae6-22173f2046db]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:16 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:16 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:16 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.448s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:17 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce 1G Nov 04 19:04:17 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:17 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce 1G" returned: 0 in 0.659s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:17 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce Nov 04 19:04:17 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce" returned: 0 in 0.581s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce is being set with open permissions: ugo+rw Nov 04 19:04:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce Nov 04 19:04:18 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce" returned: 0 in 0.649s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8cde98ce-9234-46ef-aaef-fa60fd53da6e tempest-SnapshotsActionsTest-1531793218 None] Create snapshot completed successfully Nov 04 19:04:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-8c331b2e-6260-4f60-b944-159ef5613e7b tempest-ServerActionsTestOtherA-1950031439 None] Terminate volume connection completed successfully. Nov 04 19:04:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-8c331b2e-6260-4f60-b944-159ef5613e7b tempest-ServerActionsTestOtherA-1950031439 None] Deleting attachment 22f3d6bf-1d6c-4b68-8a5d-57705f571811. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-9dff423d-9123-4f0a-848e-a2ef0299ccce-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-9dff423d-9123-4f0a-848e-a2ef0299ccce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-9dff423d-9123-4f0a-848e-a2ef0299ccce" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-9dff423d-9123-4f0a-848e-a2ef0299ccce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Deleting offline snapshot 9dff423d-9123-4f0a-848e-a2ef0299ccce of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] snapshot_file for this snap is: volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a6b152-ac10-4718-9aac-841163d6085b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:20 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce Nov 04 19:04:20 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-d50fdef8-5ba0-43e2-aa91-bc01a6e5d45c tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-d50fdef8-5ba0-43e2-aa91-bc01a6e5d45c tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-d50fdef8-5ba0-43e2-aa91-bc01a6e5d45c tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-d50fdef8-5ba0-43e2-aa91-bc01a6e5d45c tempest-ServerActionsTestOtherA-1950031439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '976f8615-9303-453c-be82-5aa81c9acc97', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:04:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-8b62bf89-9cc2-40e4-a8b5-2ab0969b6b1e req-d50fdef8-5ba0-43e2-aa91-bc01a6e5d45c tempest-ServerActionsTestOtherA-1950031439 None] attachment_update completed successfully. Nov 04 19:04:21 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce" returned: 0 in 0.699s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6795109-9ad9-4c9c-98d1-ac9a658d0562]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:21 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.487s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce Nov 04 19:04:21 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:04:22 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce" returned: 0 in 0.500s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce Nov 04 19:04:22 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.695s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 8 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:04:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:04:23 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.9dff423d-9123-4f0a-848e-a2ef0299ccce" returned: 0 in 0.794s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-9dff423d-9123-4f0a-848e-a2ef0299ccce" released by "_delete_snapshot" :: held 2.797s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_snapshot" :: held 2.841s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:23 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Created reservations ['909189f1-12b2-44d4-846e-7dd189e60eeb', '2f61c103-004a-4309-a55e-44c7e9f307a5', 'b68b70e6-27fb-4154-a94e-5e7b44506dd1', '84f6ce14-7d7c-40b9-8c27-596411db6f92'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Delete snapshot completed successfully. Nov 04 19:04:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1c5c5cad-045a-4b40-b516-58c21d25bd80 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-9dff423d-9123-4f0a-848e-a2ef0299ccce-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Creating offline snapshot a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e265b-a0bf-40b9-adda-931a342d4d69]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:24 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.511s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 1G Nov 04 19:04:24 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 1G" returned: 0 in 0.713s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 Nov 04 19:04:25 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" returned: 0 in 0.400s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 is being set with open permissions: ugo+rw Nov 04 19:04:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 Nov 04 19:04:25 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:26 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" returned: 0 in 0.446s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4886921b-2772-438c-a3f6-73f5511663fe tempest-SnapshotsActionsTest-1531793218 None] Create snapshot completed successfully Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Deleting offline snapshot a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] snapshot_file for this snap is: volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ce054-3a8a-40ea-91ea-c7612dccdeff]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:27 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 Nov 04 19:04:27 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" returned: 0 in 0.416s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dbb957-63a6-468d-97e4-09b02d0729e6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:28 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 Nov 04 19:04:28 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5 Nov 04 19:04:29 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" returned: 0 in 0.325s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5" released by "_delete_snapshot" :: held 1.758s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_snapshot" :: held 1.790s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Flow 'volume_create_manager' (955c8df1-fc32-454d-b615-bb3934d2fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e2f56a-8ef1-4aec-9282-698eaee7638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e2f56a-8ef1-4aec-9282-698eaee7638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-985448379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96d8269-7448-4459-aa98-6c3f6e2a6fb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6824e1ce8f634aae935ee970719452d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:29Z,use_quota=True,user_id='25bc3389dc0f490098aaf3f9626c9ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f742dea-7212-4bee-8e2f-d51389f61280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f742dea-7212-4bee-8e2f-d51389f61280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5957a-0811-42c4-ad7f-93d684b81cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5957a-0811-42c4-ad7f-93d684b81cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96d8269-7448-4459-aa98-6c3f6e2a6fb3', 'volume_name': 'volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa85a18-150b-44b4-b21b-77342d7da36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa85a18-150b-44b4-b21b-77342d7da36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6d7eb6-a1ee-4aee-82ba-6d4031a88562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Volume e96d8269-7448-4459-aa98-6c3f6e2a6fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3', 'volume_size': 1} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-985448379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96d8269-7448-4459-aa98-6c3f6e2a6fb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6824e1ce8f634aae935ee970719452d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:29Z,use_quota=True,user_id='25bc3389dc0f490098aaf3f9626c9ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Creating volume e96d8269-7448-4459-aa98-6c3f6e2a6fb3 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:29 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 1073741824 Nov 04 19:04:29 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Created reservations ['e3a1e68b-5698-4744-91b3-a860b8dcfdae', '55ea117e-b019-4a11-b838-84d48cad99ae', 'c8ddf4fc-155b-4099-ac88-5a7e019b7c03', '951b301f-6457-44a5-bd9a-10ac964ecf8b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Delete snapshot completed successfully. Nov 04 19:04:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ed70faf9-5c36-46be-86eb-2ead03c4bbe2 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-a9ea3cc8-0ac9-4d0e-9ecf-3f231a4c27f5-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:30 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 1073741824" returned: 0 in 0.562s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:30 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 Nov 04 19:04:30 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:30 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.257s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6d7eb6-a1ee-4aee-82ba-6d4031a88562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba0cb06-9b8d-44d9-a75c-901720957651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Creating offline snapshot cea123ca-5b83-4e7e-82e4-d995e8ee0d36 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Volume volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 (e96d8269-7448-4459-aa98-6c3f6e2a6fb3): created successfully Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba0cb06-9b8d-44d9-a75c-901720957651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Flow 'volume_create_manager' (955c8df1-fc32-454d-b615-bb3934d2fe27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063961d-9005-4f56-ac97-d6e758d422cf]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-5c12cc28-55bf-4bc4-af12-4866695bf298 req-7a76fef7-17d6-484f-8137-a7eb70350093 tempest-VolumesGetTestJSON-715241438 None] Created volume successfully. Nov 04 19:04:30 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:30 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:30 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.415s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 1G Nov 04 19:04:31 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 1G" returned: 0 in 0.601s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 Nov 04 19:04:31 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Acquiring lock "cinder-e96d8269-7448-4459-aa98-6c3f6e2a6fb3-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "cinder-e96d8269-7448-4459-aa98-6c3f6e2a6fb3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:32 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36" returned: 0 in 0.434s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 is being set with open permissions: ugo+rw Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Acquiring lock "cinder-quobyte-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:32 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 Nov 04 19:04:32 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "cinder-quobyte-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d124eb6e-a4e9-4902-8eff-e5e6b6cb5088]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 Nov 04 19:04:32 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fee768c1-53af-4c70-b300-623e61e7e6b6 tempest-SnapshotsActionsTest-1531793218 None] Create snapshot completed successfully Nov 04 19:04:32 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" returned: 0 in 0.415s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3 Nov 04 19:04:32 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "cinder-quobyte-e96d8269-7448-4459-aa98-6c3f6e2a6fb3" released by "delete_volume" :: held 0.729s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.quota [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Created reservations ['40881742-96e4-44af-aee1-f18cba179e75', '6fff854c-3605-4389-aa73-6d45eca09630', 'c8fec0da-ae13-4856-b100-a98a2ce7a5df', '79f2a885-bc42-4436-9343-76b4b2c6edca'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:04:32 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.281s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.manager [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Deleted volume successfully. Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-30ee158f-dfb7-4257-b2b7-b122eb9f2fe7 req-a417ef38-d46d-4e1b-81b0-648a3a49e28a tempest-VolumesGetTestJSON-715241438 None] Lock "cinder-e96d8269-7448-4459-aa98-6c3f6e2a6fb3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-cea123ca-5b83-4e7e-82e4-d995e8ee0d36-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-cea123ca-5b83-4e7e-82e4-d995e8ee0d36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-cea123ca-5b83-4e7e-82e4-d995e8ee0d36" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-cea123ca-5b83-4e7e-82e4-d995e8ee0d36" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Deleting offline snapshot cea123ca-5b83-4e7e-82e4-d995e8ee0d36 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] snapshot_file for this snap is: volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0b61e-ca11-4d35-8c93-f00ee89e5dd3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 Nov 04 19:04:33 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36" returned: 0 in 0.381s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e20be-cb4f-4d62-88e7-9331552b0bd0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:34 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:34 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:34 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 Nov 04 19:04:34 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36" returned: 0 in 0.489s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36 Nov 04 19:04:35 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:35 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.cea123ca-5b83-4e7e-82e4-d995e8ee0d36" returned: 0 in 0.299s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-cea123ca-5b83-4e7e-82e4-d995e8ee0d36" released by "_delete_snapshot" :: held 1.777s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_snapshot" :: held 1.808s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:35 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Created reservations ['c247c94e-1170-4029-a75e-bd8207587129', '4f334071-1645-425c-8df7-04c535da0e6b', '5cb1efce-53da-4346-a55c-ce9139c488e8', '30c304f5-61ae-43d3-8c23-6331d02816ea'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:35 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Delete snapshot completed successfully. Nov 04 19:04:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3ea04883-0441-4cff-8cb8-534c1dfcc6e6 tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-cea123ca-5b83-4e7e-82e4-d995e8ee0d36-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Creating offline snapshot 7e2719c9-873a-46ec-a763-758ddca46506 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a03100-b3b2-4aad-aebd-877b94dbeaf5]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:36 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:36 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.750s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 1G Nov 04 19:04:37 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 1G" returned: 0 in 0.868s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 Nov 04 19:04:37 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:38 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506" returned: 0 in 0.548s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:38 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 is being set with open permissions: ugo+rw Nov 04 19:04:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:38 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 Nov 04 19:04:38 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:38 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506" returned: 0 in 0.317s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-74f60a59-7fa1-407b-83ae-840f48b58159 tempest-SnapshotsActionsTest-1531793218 None] Create snapshot completed successfully Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3f7997fd-3e9a-4197-913c-e08c3c2864e9 tempest-BackendsCapabilitiesAdminTestsJSON-1052510926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5200576782227, 'free_capacity_gb': 1773.5200576782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87367) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-50465821-f788-4493-93c6-23cfee1fa215 tempest-BackendsCapabilitiesAdminTestsJSON-1052510926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5200576782227, 'free_capacity_gb': 1773.5200576782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87367) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-7e2719c9-873a-46ec-a763-758ddca46506-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-7e2719c9-873a-46ec-a763-758ddca46506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Acquiring lock "cinder-quobyte-7e2719c9-873a-46ec-a763-758ddca46506" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-7e2719c9-873a-46ec-a763-758ddca46506" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Deleting offline snapshot 7e2719c9-873a-46ec-a763-758ddca46506 of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] snapshot_file for this snap is: volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1d79ff-3084-4c3f-b284-b91ab8e51628]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:39 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 Nov 04 19:04:39 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:40 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506" returned: 0 in 0.446s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5523739-a43e-40cb-8de1-691c62321e56]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:40 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:40 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:40 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:40 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 Nov 04 19:04:40 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:41 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506" returned: 0 in 0.499s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:41 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506 Nov 04 19:04:41 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:41 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.7e2719c9-873a-46ec-a763-758ddca46506" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-7e2719c9-873a-46ec-a763-758ddca46506" released by "_delete_snapshot" :: held 1.915s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_snapshot" :: held 1.955s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=86,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Created reservations ['1174417c-089f-46be-8fd7-38fb0a452433', '578cb5c3-dfa6-43f7-872f-36a3b09ec013', '237a7b0a-477c-407e-ae77-7f46494d5ab7', 'df85beb3-d306-462a-86e0-8b2c4016aeeb'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Delete snapshot completed successfully. Nov 04 19:04:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-42ad06df-8fab-436b-8a2c-a091e06dbfdb tempest-SnapshotsActionsTest-1541613149 None] Lock "cinder-7e2719c9-873a-46ec-a763-758ddca46506-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "cinder-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "cinder-quobyte-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Deleting offline snapshot 8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f of volume dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] snapshot_file for this snap is: volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64834cf-263f-46dd-89cb-33e192355acd]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:43 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:43 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.458s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e87a64-c0fc-419f-8589-cf80b479f63b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 Nov 04 19:04:43 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:43 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" returned: 0 in 0.502s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:43 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-20179c85-6d36-4f21-89f5-8ea4c611332c req-f28db7f7-7973-4323-88f4-e6ab09d1add0 tempest-AttachVolumeNegativeTest-624908136 None] Terminate volume connection completed successfully. Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-20179c85-6d36-4f21-89f5-8ea4c611332c req-f28db7f7-7973-4323-88f4-e6ab09d1add0 tempest-AttachVolumeNegativeTest-624908136 None] Deleting attachment 9b409c0e-cac5-483c-80f4-257f5c70a445. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:04:44 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.406s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:44 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f Nov 04 19:04:44 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:44 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977.8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f" released by "_delete_snapshot" :: held 1.838s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_snapshot" :: held 1.870s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Created reservations ['db1dc54e-bd1d-49af-8f18-198d6911bc53', '8bdbe943-c4bf-4795-a682-0994fa0990c5', 'b3c29c8b-1e9a-4d84-8141-ba937cb0a983', 'a411d872-cc4e-4063-97c6-fa1bf212864c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Delete snapshot completed successfully. Nov 04 19:04:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-37d886ac-fe83-4094-90f1-a67a68f66c60 tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-8ccfcf53-e635-45df-9cb8-daa0dc4d3d5f-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "cinder-dae0b46c-a178-4ac4-a7dd-2e137a1c7977-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-dae0b46c-a178-4ac4-a7dd-2e137a1c7977-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa76895-585c-417c-ac0c-34e7ea12dd46]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 Nov 04 19:04:45 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" returned: 0 in 0.628s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977 Nov 04 19:04:45 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:46 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" returned: 0 in 0.460s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-quobyte-dae0b46c-a178-4ac4-a7dd-2e137a1c7977" released by "delete_volume" :: held 1.208s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Created reservations ['025a9ce6-f4f4-4e78-a944-03af3575df7f', '030021a3-9273-439f-9ccb-b258b20ba127', 'e56dfd40-dbb8-47a6-b412-40045060b140', '198cf82d-3647-4938-996d-3d81c0fd7efe'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:46 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:04:46 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:46 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.328s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:46 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Deleted volume successfully. Nov 04 19:04:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6ef78e5b-4a49-454c-88b5-0b181a949feb tempest-SnapshotsActionsTest-1531793218 None] Lock "cinder-dae0b46c-a178-4ac4-a7dd-2e137a1c7977-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-67c69d8a-3643-481b-921d-92aecc9d264f tempest-GroupSnapshotsV319Test-1149348748 None] Group tempest-GroupSnapshotsV319Test-Group-1228486120: creating Nov 04 19:04:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-67c69d8a-3643-481b-921d-92aecc9d264f tempest-GroupSnapshotsV319Test-1149348748 None] Group tempest-GroupSnapshotsV319Test-Group-1228486120: created successfully Nov 04 19:04:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-67c69d8a-3643-481b-921d-92aecc9d264f tempest-GroupSnapshotsV319Test-1149348748 None] Create group completed successfully. Nov 04 19:04:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-17da8bdb-d9c8-463a-9762-b37f2499ef2f req-c7901c73-45d4-443e-b716-378c38d89eb1 tempest-ServerActionsTestOtherA-1950031439 None] Terminate volume connection completed successfully. Nov 04 19:04:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-17da8bdb-d9c8-463a-9762-b37f2499ef2f req-c7901c73-45d4-443e-b716-378c38d89eb1 tempest-ServerActionsTestOtherA-1950031439 None] Deleting attachment 976f8615-9303-453c-be82-5aa81c9acc97. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=113,cinder:SELECT=116,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Flow 'volume_create_manager' (0bd615f1-d7ab-4581-a7a7-fd001970ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f28835-e144-4c43-b3ec-38ab46c712e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f28835-e144-4c43-b3ec-38ab46c712e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-809630432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d133cafa-8dda-453b-a38b-08142b59cb8e,host='devstack@QuobyteHD#QuobyteHD',id=269100c4-03ab-45ec-bc1d-d6167cb7a052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bac92c4a9449ba9a97034a3f6fcab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:50Z,use_quota=True,user_id='d1246d24680b424d98b4e11198c024fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee3fc1be-5b42-4bd0-80c6-ad0f20646e8d),volume_type_id=ee3fc1be-5b42-4bd0-80c6-ad0f20646e8d)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5008c5b-ac7b-42b4-958e-e69f363437cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5008c5b-ac7b-42b4-958e-e69f363437cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f160c041-72b9-4866-b577-e6303c8bec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f160c041-72b9-4866-b577-e6303c8bec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269100c4-03ab-45ec-bc1d-d6167cb7a052', 'volume_name': 'volume-269100c4-03ab-45ec-bc1d-d6167cb7a052', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb76623-5fc3-4e19-affb-388bd3520cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb76623-5fc3-4e19-affb-388bd3520cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9565c6-90c6-484f-acfc-977efaa857c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Volume 269100c4-03ab-45ec-bc1d-d6167cb7a052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269100c4-03ab-45ec-bc1d-d6167cb7a052', 'volume_size': 1} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d133cafa-8dda-453b-a38b-08142b59cb8e,created_at=2026-11-04T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-809630432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d133cafa-8dda-453b-a38b-08142b59cb8e,host='devstack@QuobyteHD#QuobyteHD',id=269100c4-03ab-45ec-bc1d-d6167cb7a052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bac92c4a9449ba9a97034a3f6fcab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:50Z,use_quota=True,user_id='d1246d24680b424d98b4e11198c024fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee3fc1be-5b42-4bd0-80c6-ad0f20646e8d),volume_type_id=ee3fc1be-5b42-4bd0-80c6-ad0f20646e8d)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Creating volume 269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:50 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:04:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 1073741824 Nov 04 19:04:50 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:51 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 1073741824" returned: 0 in 0.722s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:51 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 Nov 04 19:04:51 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:51 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9565c6-90c6-484f-acfc-977efaa857c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269100c4-03ab-45ec-bc1d-d6167cb7a052', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b477db-0e90-41f3-a30e-0d28c85a359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Volume volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 (269100c4-03ab-45ec-bc1d-d6167cb7a052): created successfully Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b477db-0e90-41f3-a30e-0d28c85a359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Flow 'volume_create_manager' (0bd615f1-d7ab-4581-a7a7-fd001970ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:51 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-859022bb-8d13-44b4-b595-305bc09b26cd tempest-GroupSnapshotsV319Test-1149348748 None] Created volume successfully. Nov 04 19:04:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] GroupSnapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: creating. Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Group snapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: creating. {{(pid=87367) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Creating offline snapshot 0c9898bd-d982-4605-ba72-f590472edaf4 of volume 269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb97961-1479-4304-a85d-b87305932695]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:53 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 Nov 04 19:04:53 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:53 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:53 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 1G Nov 04 19:04:53 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:54 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 1G" returned: 0 in 0.692s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:54 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 Nov 04 19:04:54 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:55 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:55 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 Nov 04 19:04:55 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:55 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4" returned: 0 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:55 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info Nov 04 19:04:55 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:55 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info" returned: 0 in 0.328s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:04:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:55 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info Nov 04 19:04:55 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:56 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.info" returned: 0 in 0.332s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ef211849-37c0-4c2c-88cd-ff236574891c tempest-GroupSnapshotsV319Test-1149348748 None] group_snapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: created successfully Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Flow 'volume_create_manager' (24d5077b-0215-4df6-ba22-ad39d7fe8d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c7945-c1ca-47f7-92d2-f1e04ee9d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06c7945-c1ca-47f7-92d2-f1e04ee9d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1192138523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82c0b01-4f14-4667-a041-74b306ed3b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba81e52fc224dc49fb0086ff53d4afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:57Z,use_quota=True,user_id='8a255b2264d8478391176f5309b662c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733bca4e-4ed6-478d-b264-7c98507241b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733bca4e-4ed6-478d-b264-7c98507241b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a103f1a8-9477-493b-9575-38b686dae9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:04:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] group_snapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: deleting Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] group_snapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: deleting {{(pid=87367) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "cinder-quobyte-0c9898bd-d982-4605-ba72-f590472edaf4" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-0c9898bd-d982-4605-ba72-f590472edaf4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Deleting offline snapshot 0c9898bd-d982-4605-ba72-f590472edaf4 of volume 269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] snapshot_file for this snap is: volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a93803-f868-4ddb-b02a-35f5d9cedd64]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a103f1a8-9477-493b-9575-38b686dae9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a82c0b01-4f14-4667-a041-74b306ed3b4c', 'volume_name': 'volume-a82c0b01-4f14-4667-a041-74b306ed3b4c', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca6eb1d-a9ee-4380-a768-c73a36e334da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca6eb1d-a9ee-4380-a768-c73a36e334da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd09e-0ecb-4926-8bf8-4d71814ff55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Volume a82c0b01-4f14-4667-a041-74b306ed3b4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a82c0b01-4f14-4667-a041-74b306ed3b4c', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:04:57 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Trying to clone a82c0b01-4f14-4667-a041-74b306ed3b4c from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:04:58 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 Nov 04 19:04:58 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:04:58 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:04:58 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4" returned: 0 in 0.791s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269100c4-03ab-45ec-bc1d-d6167cb7a052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18169a8-17d3-4b46-aede-29d7ed90041c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5517de7-c9ce-4693-956f-68cbeab6d19b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:58 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 Nov 04 19:04:58 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:58 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD Nov 04 19:04:58 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:59 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052" returned: 0 in 0.615s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:59 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:59 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 Nov 04 19:04:59 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 is fetched for user 8a255b2264d8478391176f5309b662c8. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d4292-8ecd-4e99-bf52-8ebf93cd525f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:59 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD Nov 04 19:04:59 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:59 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4" returned: 0 in 0.526s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:59 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4 Nov 04 19:04:59 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:00 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1192138523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82c0b01-4f14-4667-a041-74b306ed3b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba81e52fc224dc49fb0086ff53d4afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:57Z,use_quota=True,user_id='8a255b2264d8478391176f5309b662c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Creating volume a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:00 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1073741824 Nov 04 19:05:00 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:00 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052.0c9898bd-d982-4605-ba72-f590472edaf4" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-0c9898bd-d982-4605-ba72-f590472edaf4" released by "_delete_snapshot" :: held 2.521s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" released by "delete_snapshot" :: held 2.557s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:00 devstack cinder-volume[87367]: WARNING cinder.quota [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1605294404 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1605294404, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:05:00 devstack cinder-volume[87367]: WARNING cinder.quota [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1605294404 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1605294404, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] Created reservations ['71b501cb-e8a9-41ae-a03a-197bc3f6a1e9', 'c3e9c4fa-9ed2-4af4-b9d7-785744c2ea2b', 'af9a4c46-93f0-4b34-9a69-889338e89a7b', 'bc4515d3-06d1-4873-b8f9-aadb44d1967b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-14576008-3374-4288-a21f-2cef57a22654 tempest-GroupSnapshotsV319Test-1149348748 None] group_snapshot 1479d42e-7e34-4ad7-b08f-12acd6d939c1: deleted successfully Nov 04 19:05:00 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1073741824" returned: 0 in 0.658s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c Nov 04 19:05:00 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Attempting download of 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume a82c0b01-4f14-4667-a041-74b306ed3b4c. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2cecf4-db68-4afc-9005-c8ee6556cc3a]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:01 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco Nov 04 19:05:01 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" acquired by "delete_volume" :: waited 0.046s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[59378d3a-31d7-4a34-9db4-5d5a3f7b1631]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco" returned: 0 in 0.872s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 Nov 04 19:05:02 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:02 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco Nov 04 19:05:02 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:02 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco" returned: 1 in 0.571s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_nw0t0uco' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[689eed04-5f6a-4477-a4ee-e6fcc64fca25]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD Nov 04 19:05:02 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:02 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052" returned: 0 in 1.078s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:03 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052 Nov 04 19:05:03 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] 4ddc0397-cfae-4b65-9580-9560490b2ca6 was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:05:03 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-269100c4-03ab-45ec-bc1d-d6167cb7a052" returned: 0 in 0.569s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:03 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c Nov 04 19:05:03 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "cinder-quobyte-269100c4-03ab-45ec-bc1d-d6167cb7a052" released by "delete_volume" :: held 1.824s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Created reservations ['398c33ad-8ef9-4079-960e-d9f0941af810'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:03 devstack cinder-volume[87367]: WARNING cinder.quota [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1605294404 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1605294404, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:05:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Created reservations ['8cc4d123-92b7-4a46-91b4-ed507f5f3641', '22202fcb-845d-481f-a556-dfdc07a1c5bc', '8635b37b-62d1-4229-851a-cdec815085df', '19c18aa0-61f2-4567-a2e9-8487092092fa'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:04 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:04 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:04 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.603s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:04 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4f41e272-e468-4f03-aeaf-92ac507e52a9 tempest-GroupSnapshotsV319Test-1149348748 None] Delete group completed successfully. Nov 04 19:05:07 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c" returned: 0 in 3.639s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_34yl1o2udevstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:07 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Converted 112.00 MB image at 30.77 MB/s Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1G Nov 04 19:05:07 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:07 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c 1G" returned: 0 in 0.524s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Downloaded image 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume a82c0b01-4f14-4667-a041-74b306ed3b4c successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 for user 8a255b2264d8478391176f5309b662c8 is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Marking volume a82c0b01-4f14-4667-a041-74b306ed3b4c as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Copying metadata from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 to a82c0b01-4f14-4667-a041-74b306ed3b4c. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Creating volume glance metadata for volume a82c0b01-4f14-4667-a041-74b306ed3b4c backed by image 4ddc0397-cfae-4b65-9580-9560490b2ca6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdd09e-0ecb-4926-8bf8-4d71814ff55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82c0b01-4f14-4667-a041-74b306ed3b4c', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079cac67-3544-4dd1-b0d2-8f120d51af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Volume volume-a82c0b01-4f14-4667-a041-74b306ed3b4c (a82c0b01-4f14-4667-a041-74b306ed3b4c): created successfully Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079cac67-3544-4dd1-b0d2-8f120d51af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Flow 'volume_create_manager' (24d5077b-0215-4df6-ba22-ad39d7fe8d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-487bc6e9-c812-486e-8dfb-bbc96a7b7120 tempest-ServerActionsTestOtherA-1950031439 None] Created volume successfully. Nov 04 19:05:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-00de6b72-88e8-48bb-b81d-51d4c4846182 req-dbdabe50-ecbf-4e4a-90a0-910e3857ce72 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-00de6b72-88e8-48bb-b81d-51d4c4846182 req-dbdabe50-ecbf-4e4a-90a0-910e3857ce72 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-00de6b72-88e8-48bb-b81d-51d4c4846182 req-dbdabe50-ecbf-4e4a-90a0-910e3857ce72 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-00de6b72-88e8-48bb-b81d-51d4c4846182 req-dbdabe50-ecbf-4e4a-90a0-910e3857ce72 tempest-ServerActionsTestOtherA-1950031439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-a82c0b01-4f14-4667-a041-74b306ed3b4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86893111-3300-4b25-8cd3-dbd9c117de9a', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:05:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-00de6b72-88e8-48bb-b81d-51d4c4846182 req-dbdabe50-ecbf-4e4a-90a0-910e3857ce72 tempest-ServerActionsTestOtherA-1950031439 None] attachment_update completed successfully. Nov 04 19:05:15 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Flow 'volume_create_manager' (7fa3a38a-c312-4082-afde-0a091470e27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c4c2d7-9c69-478b-8e2b-f709617c8dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c4c2d7-9c69-478b-8e2b-f709617c8dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1748485245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6981a55-e384-4602-82ea-dac79431f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81a06b743f94eaf9e40f4ed5a09530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:16Z,use_quota=True,user_id='441707b2bc1a4138a6d6af4ab280f272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3df4f1-eede-4e94-9656-26e317648501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3df4f1-eede-4e94-9656-26e317648501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09de0cb9-1c53-4737-9a0a-9b3e3c798714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09de0cb9-1c53-4737-9a0a-9b3e3c798714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6981a55-e384-4602-82ea-dac79431f73f', 'volume_name': 'volume-f6981a55-e384-4602-82ea-dac79431f73f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6769f4d7-3229-4900-a046-5979fa35f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6769f4d7-3229-4900-a046-5979fa35f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5394896-6827-4004-8478-4a180631eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:16 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume f6981a55-e384-4602-82ea-dac79431f73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6981a55-e384-4602-82ea-dac79431f73f', 'volume_size': 1} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1748485245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6981a55-e384-4602-82ea-dac79431f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81a06b743f94eaf9e40f4ed5a09530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:16Z,use_quota=True,user_id='441707b2bc1a4138a6d6af4ab280f272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Creating volume f6981a55-e384-4602-82ea-dac79431f73f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:16 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:05:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:16 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f 1073741824 Nov 04 19:05:16 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:17 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f 1073741824" returned: 0 in 0.939s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:17 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f Nov 04 19:05:17 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:17 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f" returned: 0 in 0.393s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5394896-6827-4004-8478-4a180631eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6981a55-e384-4602-82ea-dac79431f73f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5215272f-cf95-4b27-8c16-4716349d4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume volume-f6981a55-e384-4602-82ea-dac79431f73f (f6981a55-e384-4602-82ea-dac79431f73f): created successfully Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5215272f-cf95-4b27-8c16-4716349d4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Flow 'volume_create_manager' (7fa3a38a-c312-4082-afde-0a091470e27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-68fff5d1-5e73-41f3-97b9-28c25f599988 tempest-VolumeQuotasAdminTestJSON-1935423987 None] Created volume successfully. Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "cinder-f6981a55-e384-4602-82ea-dac79431f73f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "cinder-f6981a55-e384-4602-82ea-dac79431f73f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "cinder-quobyte-f6981a55-e384-4602-82ea-dac79431f73f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "cinder-quobyte-f6981a55-e384-4602-82ea-dac79431f73f" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce33cd-f5aa-4cb4-b85c-85d6d25603a5]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:18 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f Nov 04 19:05:18 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:18 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f" returned: 0 in 0.453s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:18 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f Nov 04 19:05:18 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:19 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f6981a55-e384-4602-82ea-dac79431f73f" returned: 0 in 0.379s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "cinder-quobyte-f6981a55-e384-4602-82ea-dac79431f73f" released by "delete_volume" :: held 0.887s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Created reservations ['d6c0a7d3-d828-4874-9325-b0837253ccba', 'a711d305-f6e2-41ab-a248-a0d4f17b09f6', '7df52c6a-c373-4ea2-9c02-52590ccb12c0', 'ef13f904-649f-4be4-ac2b-e210ed5d80c0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:19 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:19 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:19 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.408s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Deleted volume successfully. Nov 04 19:05:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc34ab2-a6ec-44b2-b8ea-976ae03d76bb tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "cinder-f6981a55-e384-4602-82ea-dac79431f73f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Flow 'volume_create_manager' (6fccc7d1-245b-45ee-89dc-9391ada6eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd46f82-10bc-472d-9a7a-2223c6bf6693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd46f82-10bc-472d-9a7a-2223c6bf6693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1148908421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6a724f-1f67-4b78-a017-0bf24729348d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81a06b743f94eaf9e40f4ed5a09530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:20Z,use_quota=True,user_id='441707b2bc1a4138a6d6af4ab280f272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38cc5f9-948b-4820-8973-4c255b2d6e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38cc5f9-948b-4820-8973-4c255b2d6e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1b4ec9-938a-4257-8cfb-b2edc648c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1b4ec9-938a-4257-8cfb-b2edc648c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6a724f-1f67-4b78-a017-0bf24729348d', 'volume_name': 'volume-5a6a724f-1f67-4b78-a017-0bf24729348d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ffaf5-c37f-4b28-a7b5-268d11f1b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ffaf5-c37f-4b28-a7b5-268d11f1b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5d3d8f-5e10-472a-8dc2-4076455dd1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume 5a6a724f-1f67-4b78-a017-0bf24729348d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6a724f-1f67-4b78-a017-0bf24729348d', 'volume_size': 1} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1148908421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6a724f-1f67-4b78-a017-0bf24729348d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81a06b743f94eaf9e40f4ed5a09530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:20Z,use_quota=True,user_id='441707b2bc1a4138a6d6af4ab280f272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Creating volume 5a6a724f-1f67-4b78-a017-0bf24729348d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:20 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:05:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:20 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d 1073741824 Nov 04 19:05:20 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:21 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d 1073741824" returned: 0 in 0.916s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:21 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d Nov 04 19:05:21 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:22 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d" returned: 0 in 0.479s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5d3d8f-5e10-472a-8dc2-4076455dd1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6a724f-1f67-4b78-a017-0bf24729348d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:22 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:22 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e383b-9ed4-4b23-afc7-9af354f3e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:22 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Volume volume-5a6a724f-1f67-4b78-a017-0bf24729348d (5a6a724f-1f67-4b78-a017-0bf24729348d): created successfully Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e383b-9ed4-4b23-afc7-9af354f3e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Flow 'volume_create_manager' (6fccc7d1-245b-45ee-89dc-9391ada6eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cba99ba4-fbe2-4c44-9af2-1a236637206c tempest-VolumeQuotasAdminTestJSON-1935423987 None] Created volume successfully. Nov 04 19:05:22 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.679s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:05:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:05:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-064bc472-dffd-4112-96af-a5ac5d543679 tempest-VolumeQuotasAdminTestJSON-76071051 None] Transfer volume completed successfully. Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Acquiring lock "cinder-5a6a724f-1f67-4b78-a017-0bf24729348d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "cinder-5a6a724f-1f67-4b78-a017-0bf24729348d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Acquiring lock "cinder-quobyte-5a6a724f-1f67-4b78-a017-0bf24729348d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "cinder-quobyte-5a6a724f-1f67-4b78-a017-0bf24729348d" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c895b3-b4a3-498e-95d6-3eee244b1535]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:25 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d Nov 04 19:05:25 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:26 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d" returned: 0 in 0.810s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:26 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d Nov 04 19:05:26 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:27 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a6a724f-1f67-4b78-a017-0bf24729348d" returned: 0 in 0.684s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "cinder-quobyte-5a6a724f-1f67-4b78-a017-0bf24729348d" released by "delete_volume" :: held 1.620s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Created reservations ['38a4604b-098f-476a-8a22-24ca09debe2f', '9e8e2eed-fea7-454f-b0ec-f2f89b88aa56', '6d311b6a-5f81-4519-95a5-c806a0f0d652', '85fa9cab-2a00-4685-847e-bc48ad24b6f5'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:27 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:27 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:27 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Deleted volume successfully. Nov 04 19:05:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea50f17f-30ba-421c-ae38-041f36656116 tempest-VolumeQuotasAdminTestJSON-1972963617 None] Lock "cinder-5a6a724f-1f67-4b78-a017-0bf24729348d-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (9a0726e2-2c5e-4638-8d08-5fd94f58ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fcc9b-9d0c-488f-818c-d88a13b04761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fcc9b-9d0c-488f-818c-d88a13b04761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71797221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1933f7-46e9-446b-8064-226ea500d28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:29Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a70cd21-8770-4340-974c-64f44489224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a70cd21-8770-4340-974c-64f44489224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6ad46d-5d2c-43fd-a4b3-971bf3fc69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6ad46d-5d2c-43fd-a4b3-971bf3fc69c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1933f7-46e9-446b-8064-226ea500d28b', 'volume_name': 'volume-7c1933f7-46e9-446b-8064-226ea500d28b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e9f6b-e32a-4b84-800b-526c2ef9c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e9f6b-e32a-4b84-800b-526c2ef9c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daa5a86-ab41-4206-9d92-92cf4a82f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Volume 7c1933f7-46e9-446b-8064-226ea500d28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1933f7-46e9-446b-8064-226ea500d28b', 'volume_size': 1} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71797221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1933f7-46e9-446b-8064-226ea500d28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:29Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Creating volume 7c1933f7-46e9-446b-8064-226ea500d28b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:29 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:29 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b 1073741824 Nov 04 19:05:29 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:29 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b 1073741824" returned: 0 in 0.915s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:30 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b Nov 04 19:05:30 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:30 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b" returned: 0 in 0.559s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daa5a86-ab41-4206-9d92-92cf4a82f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1933f7-46e9-446b-8064-226ea500d28b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7a9a0-13ff-4c7b-8754-3743b99ee4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Volume volume-7c1933f7-46e9-446b-8064-226ea500d28b (7c1933f7-46e9-446b-8064-226ea500d28b): created successfully Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7a9a0-13ff-4c7b-8754-3743b99ee4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (9a0726e2-2c5e-4638-8d08-5fd94f58ed34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6c4e041e-0f1d-4000-a8ce-21448cf1099d tempest-AttachVolumeNegativeTest-624908136 None] Created volume successfully. Nov 04 19:05:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-1e8e6d24-3ffc-4c0b-b07e-5bc72d3f4b3c req-66a57a98-524b-4eef-8c86-3011479c10a4 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-1e8e6d24-3ffc-4c0b-b07e-5bc72d3f4b3c req-66a57a98-524b-4eef-8c86-3011479c10a4 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-1e8e6d24-3ffc-4c0b-b07e-5bc72d3f4b3c req-66a57a98-524b-4eef-8c86-3011479c10a4 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-1e8e6d24-3ffc-4c0b-b07e-5bc72d3f4b3c req-66a57a98-524b-4eef-8c86-3011479c10a4 tempest-AttachVolumeNegativeTest-624908136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-7c1933f7-46e9-446b-8064-226ea500d28b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4826fbe2-3a64-4766-94b0-e7e29b3ae61c', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:05:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-1e8e6d24-3ffc-4c0b-b07e-5bc72d3f4b3c req-66a57a98-524b-4eef-8c86-3011479c10a4 tempest-AttachVolumeNegativeTest-624908136 None] attachment_update completed successfully. Nov 04 19:05:34 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-42f48e22-826d-404a-9dcd-9a285563bbd4 tempest-ServerActionsTestOtherA-1950031439 None] Terminate volume connection completed successfully. Nov 04 19:05:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-42f48e22-826d-404a-9dcd-9a285563bbd4 tempest-ServerActionsTestOtherA-1950031439 None] Deleting attachment 86893111-3300-4b25-8cd3-dbd9c117de9a. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:05:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-358f1556-607b-42ff-b714-8859217cfd56 req-479655b7-29c0-4cf9-baa8-2e4bacbafe28 tempest-AttachVolumeNegativeTest-624908136 None] Terminate volume connection completed successfully. Nov 04 19:05:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-358f1556-607b-42ff-b714-8859217cfd56 req-479655b7-29c0-4cf9-baa8-2e4bacbafe28 tempest-AttachVolumeNegativeTest-624908136 None] Deleting attachment 4826fbe2-3a64-4766-94b0-e7e29b3ae61c. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:05:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-9ba785f0-4976-4598-b45e-6ac58f1968ea tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-9ba785f0-4976-4598-b45e-6ac58f1968ea tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-9ba785f0-4976-4598-b45e-6ac58f1968ea tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-9ba785f0-4976-4598-b45e-6ac58f1968ea tempest-ServerActionsTestOtherA-1950031439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-a82c0b01-4f14-4667-a041-74b306ed3b4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0cb979b-d81e-4b94-872f-60dac57547a7', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:05:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-a30816a1-7a69-4e27-81bf-21e61e42684f req-9ba785f0-4976-4598-b45e-6ac58f1968ea tempest-ServerActionsTestOtherA-1950031439 None] attachment_update completed successfully. Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=95,cinder:INSERT=23,cinder:UPDATE=79,cinder:DELETE=4 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Flow 'volume_create_manager' (3a5e65ce-ba6f-4db1-b811-62cf23df9ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca77ea8-d560-4309-ba0b-e357e448d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca77ea8-d560-4309-ba0b-e357e448d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-235434411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e92dbe-3087-41c5-bec6-c929c62d7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c22f23e8b624f7fbcdaadd8fa5b3d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:45Z,use_quota=True,user_id='efceca0099014e01ba9e7a380cf74fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86fa1fc6-05d6-4cc6-a457-35d66d9c1db5),volume_type_id=86fa1fc6-05d6-4cc6-a457-35d66d9c1db5)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e36bd5e-9ef4-41fb-805d-51819b289b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e36bd5e-9ef4-41fb-805d-51819b289b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef43f0b-6690-4d58-afa0-c88123f4bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef43f0b-6690-4d58-afa0-c88123f4bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e92dbe-3087-41c5-bec6-c929c62d7243', 'volume_name': 'volume-27e92dbe-3087-41c5-bec6-c929c62d7243', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c48b0fa-82e0-412e-a749-c7d4465ececd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c48b0fa-82e0-412e-a749-c7d4465ececd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37339a0-dea2-46f2-8ca9-1493781ada10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:45 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Volume 27e92dbe-3087-41c5-bec6-c929c62d7243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e92dbe-3087-41c5-bec6-c929c62d7243', 'volume_size': 1} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-235434411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e92dbe-3087-41c5-bec6-c929c62d7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c22f23e8b624f7fbcdaadd8fa5b3d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:45Z,use_quota=True,user_id='efceca0099014e01ba9e7a380cf74fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86fa1fc6-05d6-4cc6-a457-35d66d9c1db5),volume_type_id=86fa1fc6-05d6-4cc6-a457-35d66d9c1db5)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Creating volume 27e92dbe-3087-41c5-bec6-c929c62d7243 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:45 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:05:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:45 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 1073741824 Nov 04 19:05:45 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:46 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 1073741824" returned: 0 in 0.791s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:46 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 Nov 04 19:05:46 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:46 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37339a0-dea2-46f2-8ca9-1493781ada10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e92dbe-3087-41c5-bec6-c929c62d7243', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd58d5ba-3809-4852-ac1f-bbc92e536b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Volume volume-27e92dbe-3087-41c5-bec6-c929c62d7243 (27e92dbe-3087-41c5-bec6-c929c62d7243): created successfully Nov 04 19:05:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd58d5ba-3809-4852-ac1f-bbc92e536b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Flow 'volume_create_manager' (3a5e65ce-ba6f-4db1-b811-62cf23df9ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2f8eab42-5f47-4676-a299-c3b18613d225 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Created volume successfully. Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:48 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:48 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:48 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:48 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-de6f97ae-d950-4cbc-978d-d0d06470e248 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Retype volume completed successfully. Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "cinder-27e92dbe-3087-41c5-bec6-c929c62d7243-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "cinder-27e92dbe-3087-41c5-bec6-c929c62d7243-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=74,cinder:UPDATE=62,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "cinder-quobyte-27e92dbe-3087-41c5-bec6-c929c62d7243" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "cinder-quobyte-27e92dbe-3087-41c5-bec6-c929c62d7243" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997dca2-b17b-441d-8b29-3df55c35786f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:50 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 Nov 04 19:05:50 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:51 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243" returned: 0 in 0.774s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:51 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243 Nov 04 19:05:51 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:51 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-27e92dbe-3087-41c5-bec6-c929c62d7243" returned: 0 in 0.425s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "cinder-quobyte-27e92dbe-3087-41c5-bec6-c929c62d7243" released by "delete_volume" :: held 1.287s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:52 devstack cinder-volume[87367]: WARNING cinder.quota [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:05:52 devstack cinder-volume[87367]: WARNING cinder.quota [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Created reservations ['499d79af-a399-4f54-aef0-fcdbbbc11d90', 'f74b021e-efa4-4a70-8958-b7104bc4c104', '21772225-7621-40c9-8acb-32fecaea2874', 'db7d53a6-9345-4fbb-9afc-5da945d7d029'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:52 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:05:52 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:52 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.552s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Deleted volume successfully. Nov 04 19:05:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6acc317c-30e4-43db-8264-bc6ab2262242 tempest-VolumeRetypeWithoutMigrationTest-611615704 None] Lock "cinder-27e92dbe-3087-41c5-bec6-c929c62d7243-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:02 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:02 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Flow 'volume_create_manager' (8d7eb0e9-6efa-40f0-8f4f-fd71a1ec9459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fd6be0-7141-4eb2-b3d9-bf03a341a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fd6be0-7141-4eb2-b3d9-bf03a341a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1665597698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1dfb1a-cbae-4607-ac6c-fa4698d076ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78c4bc148674e6f85eed64bb9b892dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:05Z,use_quota=True,user_id='d4a03e425f274b80a42fe483d1f125b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c908211-7856-4d7a-8817-e696d33bd8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c908211-7856-4d7a-8817-e696d33bd8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4109ad30-499e-4f38-9640-8c4189718d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4109ad30-499e-4f38-9640-8c4189718d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1dfb1a-cbae-4607-ac6c-fa4698d076ad', 'volume_name': 'volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bf99b3-e7a1-4edf-b366-550cfb67b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bf99b3-e7a1-4edf-b366-550cfb67b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd373aaa-5698-4a1d-ace7-643231bdf530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Volume ec1dfb1a-cbae-4607-ac6c-fa4698d076ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad', 'volume_size': 1} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1665597698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1dfb1a-cbae-4607-ac6c-fa4698d076ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d78c4bc148674e6f85eed64bb9b892dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:05Z,use_quota=True,user_id='d4a03e425f274b80a42fe483d1f125b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Creating volume ec1dfb1a-cbae-4607-ac6c-fa4698d076ad {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:04 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:04 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad 1073741824 Nov 04 19:06:04 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:05 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad 1073741824" returned: 0 in 0.564s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:05 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad Nov 04 19:06:05 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:05 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd373aaa-5698-4a1d-ace7-643231bdf530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc16e1a-615d-45f9-b569-bc320ff50093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Volume volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad (ec1dfb1a-cbae-4607-ac6c-fa4698d076ad): created successfully Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc16e1a-615d-45f9-b569-bc320ff50093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Flow 'volume_create_manager' (8d7eb0e9-6efa-40f0-8f4f-fd71a1ec9459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-15bc3273-0f6b-4fd9-be91-aca44484c084 tempest-VolumesServicesTestJSON-1432149666 None] Created volume successfully. Nov 04 19:06:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Acquiring lock "cinder-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "cinder-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Acquiring lock "cinder-quobyte-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "cinder-quobyte-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce60482-f4f3-4772-829b-e483402ef700]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:07 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad Nov 04 19:06:07 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:07 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:07 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad Nov 04 19:06:07 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:07 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "cinder-quobyte-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad" released by "delete_volume" :: held 0.763s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Created reservations ['a65fea92-cda4-4d8c-b2ba-4878c5019157', 'b040770d-d084-408b-b677-e0d43915d638', '09a3c201-ac28-4a80-91b3-23f8f1a81a36', '006795c6-46d7-43b8-8fe2-ac2e2ed25573'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:07 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:07 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:08 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:08 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Deleted volume successfully. Nov 04 19:06:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-40519d4f-d17b-458f-83b8-0f6d4ee0dcbf tempest-VolumesServicesTestJSON-1432149666 None] Lock "cinder-ec1dfb1a-cbae-4607-ac6c-fa4698d076ad-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:17 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:18 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-8e29a3a0-b041-4450-b5b9-f733554e596c tempest-ServerActionsTestOtherA-1950031439 None] Terminate volume connection completed successfully. Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-8e29a3a0-b041-4450-b5b9-f733554e596c tempest-ServerActionsTestOtherA-1950031439 None] Deleting attachment f0cb979b-d81e-4b94-872f-60dac57547a7. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "cinder-a82c0b01-4f14-4667-a041-74b306ed3b4c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-a82c0b01-4f14-4667-a041-74b306ed3b4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "cinder-quobyte-a82c0b01-4f14-4667-a041-74b306ed3b4c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-quobyte-a82c0b01-4f14-4667-a041-74b306ed3b4c" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb929f5-e30e-4546-856a-178a971bc7f6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:21 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c Nov 04 19:06:21 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:22 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:22 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:22 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c" returned: 0 in 0.706s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:22 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c Nov 04 19:06:22 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:22 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.502s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:06:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:06:23 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-a82c0b01-4f14-4667-a041-74b306ed3b4c" returned: 0 in 0.485s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-quobyte-a82c0b01-4f14-4667-a041-74b306ed3b4c" released by "delete_volume" :: held 1.291s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.quota [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Created reservations ['4b74a0ee-ec99-4bf1-aaa5-b43e9ac11c3e', 'b9981549-a71b-49a3-a783-f59ad63c5cae', 'd4677dc5-7b53-4a2b-8a27-0285ad2d13b7', 'ded72f32-d5b1-4416-b16e-a3a6bd4fdfdf'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:23 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:23 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:23 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.396s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.manager [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Deleted volume successfully. Nov 04 19:06:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-ca41c2a4-8d57-4040-ae1c-48da1d584862 req-3e351805-5f86-4d0c-ad3c-deceb04b0b56 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-a82c0b01-4f14-4667-a041-74b306ed3b4c-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "cinder-04d221bd-49aa-4041-ae24-ce0b9c4b10bd-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-04d221bd-49aa-4041-ae24-ce0b9c4b10bd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "cinder-quobyte-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-quobyte-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1bad55-aa10-43c7-b663-2b453b4339b5]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:24 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd Nov 04 19:06:24 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:24 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" returned: 0 in 0.513s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:24 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd Nov 04 19:06:24 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:25 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" returned: 0 in 0.387s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-quobyte-04d221bd-49aa-4041-ae24-ce0b9c4b10bd" released by "delete_volume" :: held 0.999s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Created reservations ['f68fdc1c-dd7b-42a1-a4e3-013c9f5cda88', '9905d952-fb49-497e-b56f-4517175dce2e', '8b0336f3-8469-4574-ae7a-8894dd7ff3b5', '0fcadfb0-7add-42ee-8e44-e4551d72961e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:25 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:25 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (d3755f50-44c2-40e9-a761-dbd27ab0c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427baa06-0c41-459d-9e0b-84fb44ef22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427baa06-0c41-459d-9e0b-84fb44ef22e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-44037379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ec5b91-7861-4087-a76a-d9b0a6bb9766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:26Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fe991b-a253-473b-ace2-505092a11f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fe991b-a253-473b-ace2-505092a11f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dfb6c4-9e3e-47ba-ab12-d8d59520e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dfb6c4-9e3e-47ba-ab12-d8d59520e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ec5b91-7861-4087-a76a-d9b0a6bb9766', 'volume_name': 'volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b03c9e-7b89-432e-9eca-e3e844102ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b03c9e-7b89-432e-9eca-e3e844102ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88de65c-7109-48a7-bdc9-ef41cc3b4e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Volume d2ec5b91-7861-4087-a76a-d9b0a6bb9766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766', 'volume_size': 1} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-44037379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ec5b91-7861-4087-a76a-d9b0a6bb9766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00415a0d31ad4cfcb1266cc011f0046a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:26Z,use_quota=True,user_id='1eda9575172b40269e15847dc8326413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Creating volume d2ec5b91-7861-4087-a76a-d9b0a6bb9766 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:25 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:25 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.372s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Deleted volume successfully. Nov 04 19:06:25 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 1073741824 Nov 04 19:06:25 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-240dab60-a27d-42c0-9c64-c6f260ae3619 tempest-ServerActionsTestOtherA-1950031439 None] Lock "cinder-04d221bd-49aa-4041-ae24-ce0b9c4b10bd-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:26 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 1073741824" returned: 0 in 0.562s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:26 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 Nov 04 19:06:26 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:26 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88de65c-7109-48a7-bdc9-ef41cc3b4e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9d7988-6af0-48ab-b30d-29e74499ed48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Volume volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 (d2ec5b91-7861-4087-a76a-d9b0a6bb9766): created successfully Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9d7988-6af0-48ab-b30d-29e74499ed48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Flow 'volume_create_manager' (d3755f50-44c2-40e9-a761-dbd27ab0c93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a9a87299-fb1e-4455-948b-7a5d13cc6095 tempest-AttachVolumeNegativeTest-624908136 None] Created volume successfully. Nov 04 19:06:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e1db62dc-c119-4f06-9901-e66d36d2cde4 req-6d1bc447-ee30-4c33-b69d-ddb364e46fe3 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e1db62dc-c119-4f06-9901-e66d36d2cde4 req-6d1bc447-ee30-4c33-b69d-ddb364e46fe3 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e1db62dc-c119-4f06-9901-e66d36d2cde4 req-6d1bc447-ee30-4c33-b69d-ddb364e46fe3 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-e1db62dc-c119-4f06-9901-e66d36d2cde4 req-6d1bc447-ee30-4c33-b69d-ddb364e46fe3 tempest-AttachVolumeNegativeTest-624908136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0697c484-67f3-433a-94dc-ec4fe3d819b0', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:06:28 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-e1db62dc-c119-4f06-9901-e66d36d2cde4 req-6d1bc447-ee30-4c33-b69d-ddb364e46fe3 tempest-AttachVolumeNegativeTest-624908136 None] attachment_update completed successfully. Nov 04 19:06:31 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-c290dec5-4ac9-4b1b-b4e1-54159a4837a1 req-a631be70-e9f3-4e2a-9709-e42f96db2f44 tempest-AttachVolumeNegativeTest-624908136 None] Terminate volume connection completed successfully. Nov 04 19:06:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-c290dec5-4ac9-4b1b-b4e1-54159a4837a1 req-a631be70-e9f3-4e2a-9709-e42f96db2f44 tempest-AttachVolumeNegativeTest-624908136 None] Deleting attachment 0697c484-67f3-433a-94dc-ec4fe3d819b0. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:06:38 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-d2ec5b91-7861-4087-a76a-d9b0a6bb9766-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-d2ec5b91-7861-4087-a76a-d9b0a6bb9766-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-quobyte-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" acquired by "delete_volume" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9016265a-0cf3-40a7-a28a-86588a8a919d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:39 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 Nov 04 19:06:39 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:40 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" returned: 0 in 0.808s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:40 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766 Nov 04 19:06:40 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:40 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" returned: 0 in 0.581s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-d2ec5b91-7861-4087-a76a-d9b0a6bb9766" released by "delete_volume" :: held 1.539s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Created reservations ['0755738c-220c-4fbb-a18c-54026a1b4c57', '21268408-613d-469c-8e33-7f70b3322375', '711740b2-38ba-46e9-83d3-e54ccc90200d', '2ef13e01-4f9f-4826-bfb0-6db8d05ff6c3'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:41 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:41 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:41 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.749s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:41 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Deleted volume successfully. Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-761b00b5-5312-4710-ae36-f893f4282a68 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-d2ec5b91-7861-4087-a76a-d9b0a6bb9766-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-7c1933f7-46e9-446b-8064-226ea500d28b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-7c1933f7-46e9-446b-8064-226ea500d28b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-quobyte-7c1933f7-46e9-446b-8064-226ea500d28b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-7c1933f7-46e9-446b-8064-226ea500d28b" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c029eb-bac6-46af-9bf1-e6c406a4ee41]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:42 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b Nov 04 19:06:42 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:42 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b" returned: 0 in 0.632s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b Nov 04 19:06:43 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:43 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7c1933f7-46e9-446b-8064-226ea500d28b" returned: 0 in 0.624s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-7c1933f7-46e9-446b-8064-226ea500d28b" released by "delete_volume" :: held 1.367s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Created reservations ['b79d61fb-fb6c-489c-a750-8db7c4b55769', '524ada3e-993f-48d9-8d50-22a06c923e3f', 'ec002715-0dc4-4991-a78f-6fce508d5ee6', '398d47bc-6d2c-44af-993a-1fb678c6d705'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:43 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:43 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (8390061d-d5c5-4159-8d88-891fdd1e0815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47b007c-17d2-49a4-9969-0656fa865c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47b007c-17d2-49a4-9969-0656fa865c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-748677380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eda7824-b91a-479e-a72d-b73cabd1387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:44Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cfc972-fdf9-4d16-a0af-4d6dae636256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cfc972-fdf9-4d16-a0af-4d6dae636256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9680c4d3-75f0-4596-82d6-24bff21b24e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9680c4d3-75f0-4596-82d6-24bff21b24e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eda7824-b91a-479e-a72d-b73cabd1387f', 'volume_name': 'volume-5eda7824-b91a-479e-a72d-b73cabd1387f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd2c7be-1c3a-4476-adf3-b77750c07891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd2c7be-1c3a-4476-adf3-b77750c07891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddd0629-57be-46d6-a93d-a1e4f19bb1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Volume 5eda7824-b91a-479e-a72d-b73cabd1387f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eda7824-b91a-479e-a72d-b73cabd1387f', 'volume_size': 1} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-748677380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eda7824-b91a-479e-a72d-b73cabd1387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:44Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Creating volume 5eda7824-b91a-479e-a72d-b73cabd1387f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:44 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f 1073741824 Nov 04 19:06:44 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.684s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Deleted volume successfully. Nov 04 19:06:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d4be089b-0d11-4362-8d34-32708e7d5bb1 tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-7c1933f7-46e9-446b-8064-226ea500d28b-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-6d44b73f-aef9-48ba-9988-544e4bd46bb6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-6d44b73f-aef9-48ba-9988-544e4bd46bb6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "cinder-quobyte-6d44b73f-aef9-48ba-9988-544e4bd46bb6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-6d44b73f-aef9-48ba-9988-544e4bd46bb6" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[da838240-3f2f-48b2-8492-d689a2154e3f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f 1073741824" returned: 0 in 0.973s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f Nov 04 19:06:45 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 Nov 04 19:06:45 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f" returned: 0 in 0.667s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:45 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Flow 'volume_create_manager' (1a81a18f-7844-4f47-8a47-8febf7a8b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be914383-ffa0-43ea-a5f6-32cad7b7013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddd0629-57be-46d6-a93d-a1e4f19bb1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eda7824-b91a-479e-a72d-b73cabd1387f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ac15f-2efa-4514-a560-43d8a71b1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6" returned: 0 in 0.833s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be914383-ffa0-43ea-a5f6-32cad7b7013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815341695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566eb00c-024f-48fa-9bbf-a34a31fd0f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f4dc73383d4682be4596054b6eaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:46Z,use_quota=True,user_id='1207dbafe7494d8983699eb7bfe061f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c83b12-a07b-4c4d-96ea-055a0d52e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c83b12-a07b-4c4d-96ea-055a0d52e22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6 Nov 04 19:06:46 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d26da92-71a5-4e7d-8c12-6d94c25f5ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d26da92-71a5-4e7d-8c12-6d94c25f5ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566eb00c-024f-48fa-9bbf-a34a31fd0f16', 'volume_name': 'volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e50b59e-9ced-4a4c-b9af-36b8576e2d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e50b59e-9ced-4a4c-b9af-36b8576e2d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd19375a-4848-44e1-8427-56b6bca85cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Volume 566eb00c-024f-48fa-9bbf-a34a31fd0f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16', 'volume_size': 1} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1815341695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566eb00c-024f-48fa-9bbf-a34a31fd0f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f4dc73383d4682be4596054b6eaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:46Z,use_quota=True,user_id='1207dbafe7494d8983699eb7bfe061f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Creating volume 566eb00c-024f-48fa-9bbf-a34a31fd0f16 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:46 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Volume volume-5eda7824-b91a-479e-a72d-b73cabd1387f (5eda7824-b91a-479e-a72d-b73cabd1387f): created successfully Nov 04 19:06:46 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 1073741824 Nov 04 19:06:46 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ac15f-2efa-4514-a560-43d8a71b1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (8390061d-d5c5-4159-8d88-891fdd1e0815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3e957e4a-193b-4e61-b132-092e0eba6408 tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:06:46 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6d44b73f-aef9-48ba-9988-544e4bd46bb6" returned: 0 in 0.394s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-quobyte-6d44b73f-aef9-48ba-9988-544e4bd46bb6" released by "delete_volume" :: held 1.289s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Created reservations ['1d6e160f-00a6-4949-98fa-b235a796ffe5', '5a78acdf-a119-442f-92ea-b13ee4479fd4', 'e8fc2a0c-a3f0-473c-ab7e-c8df189becab', 'dcad520f-4e04-4978-a817-b946162bcdb1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:46 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 1073741824" returned: 0 in 0.583s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 Nov 04 19:06:46 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.432s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:47 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Deleted volume successfully. Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd19375a-4848-44e1-8427-56b6bca85cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14196395-52c0-44cb-839a-d13835ef2872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4326ccf4-e5d9-4bb1-8715-9b66c250c09c tempest-AttachVolumeNegativeTest-624908136 None] Lock "cinder-6d44b73f-aef9-48ba-9988-544e4bd46bb6-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Volume volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 (566eb00c-024f-48fa-9bbf-a34a31fd0f16): created successfully Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14196395-52c0-44cb-839a-d13835ef2872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Flow 'volume_create_manager' (1a81a18f-7844-4f47-8a47-8febf7a8b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d40f1997-9ff3-481a-977a-2f15415c1754 tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f" by "attach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-08ede80d-1954-4790-bd23-42027c4e34e6 tempest-VolumesTransfersTest-1880247164 None] Created volume successfully. Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d40f1997-9ff3-481a-977a-2f15415c1754 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f" acquired by "attach_volume" :: waited 0.044s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d40f1997-9ff3-481a-977a-2f15415c1754 tempest-VolumesActionsTest-537525263 None] Attaching volume 5eda7824-b91a-479e-a72d-b73cabd1387f to instance 75054ae5-fb9c-4945-81af-adc071784da6 at mountpoint /dev/vdb on host None. Nov 04 19:06:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d40f1997-9ff3-481a-977a-2f15415c1754 tempest-VolumesActionsTest-537525263 None] Attach volume completed successfully. Nov 04 19:06:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d40f1997-9ff3-481a-977a-2f15415c1754 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f" released by "attach_volume" :: held 0.182s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Terminate volume connection completed successfully. Nov 04 19:06:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" by "detach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Detaching volume 5eda7824-b91a-479e-a72d-b73cabd1387f from instance 75054ae5-fb9c-4945-81af-adc071784da6. Nov 04 19:06:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Detach volume completed successfully. Nov 04 19:06:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ea11a812-7bcd-44a2-b506-df8b36698af5 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-065df3f0-a1d2-4faa-9547-3d719722ec30 tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" by "detach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-065df3f0-a1d2-4faa-9547-3d719722ec30 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-065df3f0-a1d2-4faa-9547-3d719722ec30 tempest-VolumesActionsTest-537525263 None] Volume detach called, but volume not attached. Nov 04 19:06:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d51c0679-411a-4987-addf-921e11d33978 tempest-VolumesTransfersTest-101665847 None] Transfer volume completed successfully. Nov 04 19:06:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-065df3f0-a1d2-4faa-9547-3d719722ec30 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-quobyte-5eda7824-b91a-479e-a72d-b73cabd1387f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "cinder-quobyte-5eda7824-b91a-479e-a72d-b73cabd1387f" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[da489a02-9985-44f6-8a90-b7a40b0c499d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f Nov 04 19:06:50 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Acquiring lock "cinder-566eb00c-024f-48fa-9bbf-a34a31fd0f16-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "cinder-566eb00c-024f-48fa-9bbf-a34a31fd0f16-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Acquiring lock "cinder-quobyte-566eb00c-024f-48fa-9bbf-a34a31fd0f16" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "cinder-quobyte-566eb00c-024f-48fa-9bbf-a34a31fd0f16" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:50 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f" returned: 0 in 0.795s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[69219d2e-d618-47fb-afbf-25de89181e9d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f Nov 04 19:06:51 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 Nov 04 19:06:51 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5eda7824-b91a-479e-a72d-b73cabd1387f" returned: 0 in 0.584s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "cinder-quobyte-5eda7824-b91a-479e-a72d-b73cabd1387f" released by "delete_volume" :: held 1.467s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Created reservations ['7581fc75-9a51-4a65-a600-7c844b2d6a36', '2d6bbb2a-f1fa-446a-93f6-f43adea3b55b', 'dc561d18-545f-4ac9-b3e8-8f435c5dd9cf', 'e85ffb98-ae0b-4426-ad8c-f48308e7bccf'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:51 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16" returned: 0 in 0.755s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16 Nov 04 19:06:51 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:52 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-566eb00c-024f-48fa-9bbf-a34a31fd0f16" returned: 0 in 0.478s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "cinder-quobyte-566eb00c-024f-48fa-9bbf-a34a31fd0f16" released by "delete_volume" :: held 1.329s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Created reservations ['01dc3afc-addd-4798-8bdc-b8ddab9dedef', 'caf426c5-1f50-4c37-8487-dd1f080e7399', 'f9fa26d6-79ad-42a3-a6f1-5b218741fc06', 'f3ac5fc2-f807-440b-a0c3-99f6d1ecc4a4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:52 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.423s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Deleted volume successfully. Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eb63bdbe-cdf3-4049-a676-eaac77223e97 tempest-VolumesActionsTest-537525263 None] Lock "cinder-5eda7824-b91a-479e-a72d-b73cabd1387f-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:52 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:53 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Deleted volume successfully. Nov 04 19:06:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d49cf73e-4e1e-4966-ac6b-0abf9bcc0304 tempest-VolumesTransfersTest-656952006 None] Lock "cinder-566eb00c-024f-48fa-9bbf-a34a31fd0f16-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Flow 'volume_create_manager' (445c7be9-ff7f-408d-b759-accb1286cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70842e2d-b8d0-4a89-9b62-5a41aeac9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70842e2d-b8d0-4a89-9b62-5a41aeac9c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1176215314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf85f01-ad07-4a9d-ba13-aeb63c041aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f4dc73383d4682be4596054b6eaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:54Z,use_quota=True,user_id='1207dbafe7494d8983699eb7bfe061f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e9b9b-4807-4e84-9131-0f58dcde8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e9b9b-4807-4e84-9131-0f58dcde8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b19bcf6-4360-4f8e-80dd-384c415ae247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b19bcf6-4360-4f8e-80dd-384c415ae247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf85f01-ad07-4a9d-ba13-aeb63c041aa4', 'volume_name': 'volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c99112-5429-4968-8a89-8422b7b74eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c99112-5429-4968-8a89-8422b7b74eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1a195b-0dc4-4400-a60c-87cc304db71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Volume abf85f01-ad07-4a9d-ba13-aeb63c041aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4', 'volume_size': 1} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1176215314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf85f01-ad07-4a9d-ba13-aeb63c041aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8f4dc73383d4682be4596054b6eaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:54Z,use_quota=True,user_id='1207dbafe7494d8983699eb7bfe061f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Creating volume abf85f01-ad07-4a9d-ba13-aeb63c041aa4 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:54 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:54 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 1073741824 Nov 04 19:06:54 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 1073741824" returned: 0 in 0.642s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:54 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 Nov 04 19:06:54 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:55 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" returned: 0 in 0.300s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1a195b-0dc4-4400-a60c-87cc304db71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d08651-818a-46ba-9fde-9243499a363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Volume volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 (abf85f01-ad07-4a9d-ba13-aeb63c041aa4): created successfully Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d08651-818a-46ba-9fde-9243499a363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Flow 'volume_create_manager' (445c7be9-ff7f-408d-b759-accb1286cc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2d0e709d-593b-45d1-b4c0-de63a81dbe2f tempest-VolumesTransfersTest-1880247164 None] Created volume successfully. Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Acquiring lock "cinder-abf85f01-ad07-4a9d-ba13-aeb63c041aa4-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "cinder-abf85f01-ad07-4a9d-ba13-aeb63c041aa4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Acquiring lock "cinder-quobyte-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "cinder-quobyte-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c6650e-f9d7-4e11-be0e-96cb6f1981f9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:56 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 Nov 04 19:06:56 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:57 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" returned: 0 in 0.507s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:57 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4 Nov 04 19:06:57 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:57 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "cinder-quobyte-abf85f01-ad07-4a9d-ba13-aeb63c041aa4" released by "delete_volume" :: held 0.984s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Created reservations ['678b3991-eddd-4ce2-91fc-f59a757aff48', '93eec772-235e-4e43-81c2-934ba4802580', 'd82a86c8-ea4e-4c28-a2c4-d2847d03d846', '4583fb8d-e567-4643-89df-82e0df1cb1a1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:58 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:06:58 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:58 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.464s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Deleted volume successfully. Nov 04 19:06:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d264153a-db88-47cb-8c0b-a388056d9e3d tempest-VolumesTransfersTest-656952006 None] Lock "cinder-abf85f01-ad07-4a9d-ba13-aeb63c041aa4-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (9b1528ce-8583-4678-9311-d1ab070445af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eced993-ea63-4e48-b7fb-b5b487badf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eced993-ea63-4e48-b7fb-b5b487badf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1077571864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e75006c-a738-4a29-9ddc-852ac2402664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:00Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbee733-19ea-494d-903f-ef5c731cd2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbee733-19ea-494d-903f-ef5c731cd2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d5f167-2185-402e-90bb-c26fbc3fa2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d5f167-2185-402e-90bb-c26fbc3fa2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e75006c-a738-4a29-9ddc-852ac2402664', 'volume_name': 'volume-0e75006c-a738-4a29-9ddc-852ac2402664', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9300c29-7646-4226-960c-05b4ac7b03c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9300c29-7646-4226-960c-05b4ac7b03c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dba5cf9-52f9-4212-a94a-fc0b4ab86f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Volume 0e75006c-a738-4a29-9ddc-852ac2402664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e75006c-a738-4a29-9ddc-852ac2402664', 'volume_size': 1} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1077571864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e75006c-a738-4a29-9ddc-852ac2402664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:00Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Creating volume 0e75006c-a738-4a29-9ddc-852ac2402664 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:59 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:06:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:00 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 1073741824 Nov 04 19:07:00 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:00 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 1073741824" returned: 0 in 0.593s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:00 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 Nov 04 19:07:00 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:00 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664" returned: 0 in 0.334s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dba5cf9-52f9-4212-a94a-fc0b4ab86f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e75006c-a738-4a29-9ddc-852ac2402664', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1799c603-a51c-4e69-991d-c5aae6b12171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Volume volume-0e75006c-a738-4a29-9ddc-852ac2402664 (0e75006c-a738-4a29-9ddc-852ac2402664): created successfully Nov 04 19:07:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1799c603-a51c-4e69-991d-c5aae6b12171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (9b1528ce-8583-4678-9311-d1ab070445af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e06f2e47-82a1-4923-99b6-df8c336163a2 tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-0e75006c-a738-4a29-9ddc-852ac2402664-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-0e75006c-a738-4a29-9ddc-852ac2402664-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-quobyte-0e75006c-a738-4a29-9ddc-852ac2402664" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-0e75006c-a738-4a29-9ddc-852ac2402664" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c97b3-7069-469d-9da0-5d6b7e394c56]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:02 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 Nov 04 19:07:02 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:02 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664" returned: 0 in 0.521s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664 Nov 04 19:07:03 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:03 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e75006c-a738-4a29-9ddc-852ac2402664" returned: 0 in 0.536s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-0e75006c-a738-4a29-9ddc-852ac2402664" released by "delete_volume" :: held 1.129s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Created reservations ['bc3c91ac-829a-4135-84ae-59bbc85d732e', 'eeb31761-e942-408b-b941-d413e847986b', '8d0e5313-045d-44ef-ad16-9d8253a8b2eb', '6238079d-9700-41cf-926a-0bd6d2465d20'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:03 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:03 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:04 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Deleted volume successfully. Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d876e5f5-05eb-43c8-967e-0400cb9bf0b1 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-0e75006c-a738-4a29-9ddc-852ac2402664-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (cf8d1efe-1c90-48b0-94dd-ed8c8e62b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd4fef8-f714-4902-94ac-c2fc34aad6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd4fef8-f714-4902-94ac-c2fc34aad6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1934640764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5316360e-237d-444c-bbca-33aa7178fd10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:04Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f6a8ed-a519-4db1-a640-d0f72150cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f6a8ed-a519-4db1-a640-d0f72150cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8278d858-016c-44bc-9d2a-f992cb189adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8278d858-016c-44bc-9d2a-f992cb189adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5316360e-237d-444c-bbca-33aa7178fd10', 'volume_name': 'volume-5316360e-237d-444c-bbca-33aa7178fd10', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a46683-40f2-4dd9-a23f-461dcffdddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a46683-40f2-4dd9-a23f-461dcffdddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60537072-99c6-4b84-8823-f325a53e9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Volume 5316360e-237d-444c-bbca-33aa7178fd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5316360e-237d-444c-bbca-33aa7178fd10', 'volume_size': 1} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1934640764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5316360e-237d-444c-bbca-33aa7178fd10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:04Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Creating volume 5316360e-237d-444c-bbca-33aa7178fd10 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:04 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:04 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 1073741824 Nov 04 19:07:04 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 1073741824" returned: 0 in 0.705s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 Nov 04 19:07:05 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:05 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (18bf86f3-9eb6-45ce-8634-a8b815cc4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594de905-b77a-4b0a-9b1b-17918d2d39f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10" returned: 0 in 0.393s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594de905-b77a-4b0a-9b1b-17918d2d39f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434862362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e683e71d-0e26-4842-bc81-228801dfc26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:06Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ea95e-d201-4b21-aef5-dfb96fdeccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ea95e-d201-4b21-aef5-dfb96fdeccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39703c30-2b20-404d-b791-1614f7900343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39703c30-2b20-404d-b791-1614f7900343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e683e71d-0e26-4842-bc81-228801dfc26a', 'volume_name': 'volume-e683e71d-0e26-4842-bc81-228801dfc26a', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b6cbca-5290-4722-9148-b6ddfaf60158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b6cbca-5290-4722-9148-b6ddfaf60158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aa5d46-36e0-49a6-9a25-2a367f5a070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Volume e683e71d-0e26-4842-bc81-228801dfc26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e683e71d-0e26-4842-bc81-228801dfc26a', 'volume_size': 1} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1434862362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e683e71d-0e26-4842-bc81-228801dfc26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:06Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Creating volume e683e71d-0e26-4842-bc81-228801dfc26a {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:05 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60537072-99c6-4b84-8823-f325a53e9179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5316360e-237d-444c-bbca-33aa7178fd10', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a 1073741824 Nov 04 19:07:05 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dadb023-689e-4e80-86a2-ba7f85a62d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Volume volume-5316360e-237d-444c-bbca-33aa7178fd10 (5316360e-237d-444c-bbca-33aa7178fd10): created successfully Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dadb023-689e-4e80-86a2-ba7f85a62d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (cf8d1efe-1c90-48b0-94dd-ed8c8e62b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fbde06a9-07b0-43a3-ba5f-1b451cdbef74 tempest-VolumesTestJSON-1850383284 None] Created volume successfully. Nov 04 19:07:06 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a 1073741824" returned: 0 in 0.646s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:06 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a Nov 04 19:07:06 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:06 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a" returned: 0 in 0.377s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82aa5d46-36e0-49a6-9a25-2a367f5a070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e683e71d-0e26-4842-bc81-228801dfc26a', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c542c79-5a63-48c5-9922-6a143c7dfd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:06 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Volume volume-e683e71d-0e26-4842-bc81-228801dfc26a (e683e71d-0e26-4842-bc81-228801dfc26a): created successfully Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c542c79-5a63-48c5-9922-6a143c7dfd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (18bf86f3-9eb6-45ce-8634-a8b815cc4095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-44d4a2b0-0827-47b6-856b-73e1949dfce4 tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (d3983536-1cef-4a61-8992-74909499cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436f6aa-908a-4f21-bb8f-9bad88905ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436f6aa-908a-4f21-bb8f-9bad88905ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1536769028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:07Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25cd008-d94f-4e91-a94b-cd9fd3edc19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25cd008-d94f-4e91-a94b-cd9fd3edc19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2648b2-a91a-4e3c-901a-ca47a956c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2648b2-a91a-4e3c-901a-ca47a956c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3', 'volume_name': 'volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b74d9c0-dfe8-4380-b2f7-f048ccddb9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b74d9c0-dfe8-4380-b2f7-f048ccddb9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a8b3f5-141e-429c-b970-fc8ebf0b5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Volume 7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3', 'volume_size': 1} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1536769028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:07Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Creating volume 7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:07 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 1073741824 Nov 04 19:07:07 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-e683e71d-0e26-4842-bc81-228801dfc26a-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 1073741824" returned: 0 in 0.641s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "cinder-e683e71d-0e26-4842-bc81-228801dfc26a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-quobyte-e683e71d-0e26-4842-bc81-228801dfc26a" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:08 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-e683e71d-0e26-4842-bc81-228801dfc26a" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd02db1-522a-494d-82ca-4b04e692e7aa]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a Nov 04 19:07:08 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:08 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" returned: 0 in 0.350s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a8b3f5-141e-429c-b970-fc8ebf0b5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46d17b0-14a8-4246-91e9-1cf23787f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Volume volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 (7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3): created successfully Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46d17b0-14a8-4246-91e9-1cf23787f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (d3983536-1cef-4a61-8992-74909499cc16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-16b2119d-49ce-48fc-b7b9-a2e300b9382c tempest-VolumesTestJSON-1850383284 None] Created volume successfully. Nov 04 19:07:08 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a" returned: 0 in 0.591s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:08 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a Nov 04 19:07:08 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:09 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e683e71d-0e26-4842-bc81-228801dfc26a" returned: 0 in 0.693s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-e683e71d-0e26-4842-bc81-228801dfc26a" released by "delete_volume" :: held 1.371s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Created reservations ['41d7ac4e-2412-4a1e-9419-0980c150efd3', '710fb21a-1eae-4eaf-87d4-40fa07ec50c1', '9edad5bd-68ba-40e5-b5d3-f2b4453e48fd', 'a544fbfd-4415-4198-8ac5-b015304295a8'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:10 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (a95bb054-3c5b-4df9-aff9-454d3c19c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acac25c2-4c9e-48de-afd2-a80c1fa96f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acac25c2-4c9e-48de-afd2-a80c1fa96f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173551220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f6d790-e5b4-4544-8849-6d8b1e2943ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:10Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24da0f0-c06e-4cc2-9077-fe1bda0c4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24da0f0-c06e-4cc2-9077-fe1bda0c4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb75ea6a-b07b-4359-ae40-83e3f2c98599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb75ea6a-b07b-4359-ae40-83e3f2c98599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f6d790-e5b4-4544-8849-6d8b1e2943ff', 'volume_name': 'volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346d000f-f27b-4513-9fc0-4e0a7520b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346d000f-f27b-4513-9fc0-4e0a7520b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b7dc31-1f0e-43cd-a3c2-1e097e7a66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Volume 50f6d790-e5b4-4544-8849-6d8b1e2943ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff', 'volume_size': 1} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173551220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f6d790-e5b4-4544-8849-6d8b1e2943ff,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:10Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:10 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Creating volume 50f6d790-e5b4-4544-8849-6d8b1e2943ff {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:10 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Deleted volume successfully. Nov 04 19:07:10 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff 1073741824 Nov 04 19:07:10 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a05d4a6-c3e3-4ee3-bfb9-1efd9b1de58a tempest-VolumesActionsTest-2079770481 None] Lock "cinder-e683e71d-0e26-4842-bc81-228801dfc26a-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (a70dd699-43f0-467b-a0b2-fc515d8f2071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04b58d-3f1d-4dff-bdb6-a99be177fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf04b58d-3f1d-4dff-bdb6-a99be177fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-419446334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7448bb5-3009-4024-89ea-7a8a11c287b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:11Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daaa40f-c841-49ca-8f01-c3625a3ba7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2daaa40f-c841-49ca-8f01-c3625a3ba7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98d8a0-1eb1-495f-ad74-e648fd24adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98d8a0-1eb1-495f-ad74-e648fd24adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7448bb5-3009-4024-89ea-7a8a11c287b6', 'volume_name': 'volume-c7448bb5-3009-4024-89ea-7a8a11c287b6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ad1529-9bd5-4a5c-8b2d-a40c405a4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ad1529-9bd5-4a5c-8b2d-a40c405a4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f5cb9-f4da-4aa8-8230-565245aa2820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Volume c7448bb5-3009-4024-89ea-7a8a11c287b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7448bb5-3009-4024-89ea-7a8a11c287b6', 'volume_size': 1} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff 1073741824" returned: 0 in 1.072s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff Nov 04 19:07:11 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (ebd62a5b-f5fe-4184-b0c2-b68364d82a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b6031-9fd0-4430-8747-23044b91c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b6031-9fd0-4430-8747-23044b91c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1279990318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a43ee2e-e4b3-44d2-a28f-f0c101d71948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:12Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a4a0f8-2a27-46b8-99e7-e960cf28ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a4a0f8-2a27-46b8-99e7-e960cf28ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0941107-7622-4027-a703-4722f7d40b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0941107-7622-4027-a703-4722f7d40b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a43ee2e-e4b3-44d2-a28f-f0c101d71948', 'volume_name': 'volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5195f-6164-4763-b647-c43a11799921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c5195f-6164-4763-b647-c43a11799921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d0f6f-f193-4f57-b4e1-33354c86536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Volume 6a43ee2e-e4b3-44d2-a28f-f0c101d71948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948', 'volume_size': 1} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-419446334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7448bb5-3009-4024-89ea-7a8a11c287b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2e8c712028bd4803ae603b56d04e0c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:11Z,use_quota=True,user_id='96e11d626fb841bfa0790223a4a7e2fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Creating volume c7448bb5-3009-4024-89ea-7a8a11c287b6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:11 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b7dc31-1f0e-43cd-a3c2-1e097e7a66cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 1073741824 Nov 04 19:07:11 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf069859-23f9-4495-8961-09e976359fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Volume volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff (50f6d790-e5b4-4544-8849-6d8b1e2943ff): created successfully Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf069859-23f9-4495-8961-09e976359fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (a95bb054-3c5b-4df9-aff9-454d3c19c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9456fd95-7857-4a6a-a506-6feaceaef835 tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:07:12 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 1073741824" returned: 0 in 0.719s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:12 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 Nov 04 19:07:12 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6" returned: 0 in 0.505s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1279990318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a43ee2e-e4b3-44d2-a28f-f0c101d71948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:12Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Creating volume 6a43ee2e-e4b3-44d2-a28f-f0c101d71948 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:13 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f5cb9-f4da-4aa8-8230-565245aa2820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7448bb5-3009-4024-89ea-7a8a11c287b6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4de631-2039-410a-aac6-9bc935a56742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 1073741824 Nov 04 19:07:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Volume volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 (c7448bb5-3009-4024-89ea-7a8a11c287b6): created successfully Nov 04 19:07:13 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4de631-2039-410a-aac6-9bc935a56742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Flow 'volume_create_manager' (a70dd699-43f0-467b-a0b2-fc515d8f2071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e23833b7-de67-48a3-add4-dbd0a476f0c8 tempest-VolumesTestJSON-1850383284 None] Created volume successfully. Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (62427d8f-e37b-4f44-8a86-c1ef4a844c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8e11b9-c904-4293-9984-b3ea87b95648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8e11b9-c904-4293-9984-b3ea87b95648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1336008697',display_name='tempest-VolumesGetTest-Volume-97897996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d8a9da-8f43-4ecb-adcb-db99a69068a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:13Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1055e0b-9070-4cf4-992a-3e8592333eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1055e0b-9070-4cf4-992a-3e8592333eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1b820-6fa8-47fb-bf0a-b8bd64cd1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1b820-6fa8-47fb-bf0a-b8bd64cd1a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d8a9da-8f43-4ecb-adcb-db99a69068a5', 'volume_name': 'volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d07f2-7723-4721-bec0-6c1b02383315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d07f2-7723-4721-bec0-6c1b02383315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2895dd9e-bd9e-466a-a6c3-dc4ad24e8eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Volume b9d8a9da-8f43-4ecb-adcb-db99a69068a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5', 'volume_size': 1} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:13 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 1073741824" returned: 0 in 0.712s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:14 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 Nov 04 19:07:14 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" returned: 0 in 0.455s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1336008697',display_name='tempest-VolumesGetTest-Volume-97897996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d8a9da-8f43-4ecb-adcb-db99a69068a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:13Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Creating volume b9d8a9da-8f43-4ecb-adcb-db99a69068a5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:14 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d0f6f-f193-4f57-b4e1-33354c86536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:14 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 1073741824 Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7939f594-b245-47af-83b9-333907d5beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:14 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Volume volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 (6a43ee2e-e4b3-44d2-a28f-f0c101d71948): created successfully Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7939f594-b245-47af-83b9-333907d5beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (ebd62a5b-f5fe-4184-b0c2-b68364d82a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a1b6d696-af40-41af-bf6f-baa53990e88e tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:07:15 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-6a43ee2e-e4b3-44d2-a28f-f0c101d71948-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 1073741824" returned: 0 in 0.774s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-6a43ee2e-e4b3-44d2-a28f-f0c101d71948-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-quobyte-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:15 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 Nov 04 19:07:15 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" acquired by "delete_volume" :: waited 0.043s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66ecdd-2c00-4d87-814d-2b4da197a9f4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-c7448bb5-3009-4024-89ea-7a8a11c287b6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-c7448bb5-3009-4024-89ea-7a8a11c287b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-quobyte-c7448bb5-3009-4024-89ea-7a8a11c287b6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:15 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 Nov 04 19:07:15 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-c7448bb5-3009-4024-89ea-7a8a11c287b6" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[10765305-46f9-4c17-b2f4-4d3f779ca562]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:15 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" returned: 0 in 0.459s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2895dd9e-bd9e-466a-a6c3-dc4ad24e8eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fbf14c-f376-4389-9cbf-4877d6a168d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:15 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Volume volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 (b9d8a9da-8f43-4ecb-adcb-db99a69068a5): created successfully Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fbf14c-f376-4389-9cbf-4877d6a168d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (62427d8f-e37b-4f44-8a86-c1ef4a844c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0385538b-5dbc-4eb0-bc53-0117d9255c04 tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:07:15 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 Nov 04 19:07:15 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" returned: 0 in 0.500s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:16 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948 Nov 04 19:07:16 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6" returned: 0 in 0.472s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:16 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6 Nov 04 19:07:16 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-6a43ee2e-e4b3-44d2-a28f-f0c101d71948" released by "delete_volume" :: held 0.844s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Created reservations ['d2a2d4d5-3a91-43a7-bc9e-56c4f1807ec7', '9868a2b3-44be-475a-a8af-2dbf6740c56c', 'e47e956c-ebaf-4894-b354-c89cfec23d42', '02489b0e-2ff1-455a-b0dc-c4308ff3e378'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:16 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:16 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c7448bb5-3009-4024-89ea-7a8a11c287b6" returned: 0 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-c7448bb5-3009-4024-89ea-7a8a11c287b6" released by "delete_volume" :: held 0.877s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Created reservations ['226cc9c8-60dd-4f5a-abaa-2baa793995a2', '94c16ad0-0a66-4e59-a9ae-b79583dd3564', 'ef39f3a1-d0eb-4771-9b2a-845835c98b3c', '7b32b531-963a-487b-a84f-55090a3afad6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:16 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-b9d8a9da-8f43-4ecb-adcb-db99a69068a5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Deleted volume successfully. Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "cinder-b9d8a9da-8f43-4ecb-adcb-db99a69068a5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:16 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:16 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7fa57a4e-acfd-4473-9d7f-336a212ff994 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-6a43ee2e-e4b3-44d2-a28f-f0c101d71948-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" acquired by "delete_volume" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9025babe-e1db-42bc-aa8e-30f267af9b4e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-quobyte-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[69347164-06f4-4c49-9b1f-1541ee2fa57c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:17 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 Nov 04 19:07:17 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:17 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Deleted volume successfully. Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fe9f2121-5c81-444f-9345-b15b4b760197 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-c7448bb5-3009-4024-89ea-7a8a11c287b6-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:17 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 Nov 04 19:07:17 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:17 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" returned: 0 in 0.466s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:17 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5 Nov 04 19:07:17 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:17 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" returned: 0 in 0.501s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:17 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3 Nov 04 19:07:17 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:17 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" returned: 0 in 0.290s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b9d8a9da-8f43-4ecb-adcb-db99a69068a5" released by "delete_volume" :: held 0.814s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:17 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Created reservations ['efa609cb-1769-4979-be6f-65141afe6123', '87b246f0-16b9-46ba-8fb8-6d10cd328364', 'd737fd10-2610-459f-aadb-e410ac62222b', '49994bf0-cc8f-4759-a3ef-bd20d793cc0f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:18 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" returned: 0 in 0.385s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3" released by "delete_volume" :: held 0.977s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:18 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Created reservations ['a0ba489b-af13-493e-a078-db07f15822ed', 'c7e0e728-9a9c-46c3-82c9-5596fdbc28f0', '50e9782c-2e21-4d5e-aad4-d63d5e1f4e75', '174a9bdc-f779-48ae-af0b-4cec0c0d80a5'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (f803c42f-8d97-464a-9737-454df671b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea06ad0-cf70-47fb-af77-6d88af5f56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=102,cinder:UPDATE=160,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea06ad0-cf70-47fb-af77-6d88af5f56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162598911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627fca62-6018-4755-8fe0-7284ed59d80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:18Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01104eeb-f73d-4645-919c-9bd507222bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01104eeb-f73d-4645-919c-9bd507222bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d70e21-ed2b-489b-925e-d7bf03386027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d70e21-ed2b-489b-925e-d7bf03386027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627fca62-6018-4755-8fe0-7284ed59d80c', 'volume_name': 'volume-627fca62-6018-4755-8fe0-7284ed59d80c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a8c99-a4dd-4b73-8888-8d9d9d41df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a8c99-a4dd-4b73-8888-8d9d9d41df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2733f228-dc60-46ff-b395-22a0d3032252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Volume 627fca62-6018-4755-8fe0-7284ed59d80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627fca62-6018-4755-8fe0-7284ed59d80c', 'volume_size': 1} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162598911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627fca62-6018-4755-8fe0-7284ed59d80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:18Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Creating volume 627fca62-6018-4755-8fe0-7284ed59d80c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:18 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c 1073741824 Nov 04 19:07:18 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:07:18 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:18 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e43394e1-3477-4e01-87c1-62e5729a9d49 tempest-VolumesGetTest-1947944500 None] Lock "cinder-b9d8a9da-8f43-4ecb-adcb-db99a69068a5-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:18 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.306s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Deleted volume successfully. Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9e017411-6ed5-431b-bf33-428a833582f8 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-7be6f3c6-6c96-4e4c-ba98-56fa7bc176c3-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:18 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c 1073741824" returned: 0 in 0.488s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:18 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c Nov 04 19:07:18 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:19 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c" returned: 0 in 0.300s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2733f228-dc60-46ff-b395-22a0d3032252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627fca62-6018-4755-8fe0-7284ed59d80c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a58afe0-5782-4298-952d-ef43ad4a61e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-50f6d790-e5b4-4544-8849-6d8b1e2943ff-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Volume volume-627fca62-6018-4755-8fe0-7284ed59d80c (627fca62-6018-4755-8fe0-7284ed59d80c): created successfully Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a58afe0-5782-4298-952d-ef43ad4a61e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (f803c42f-8d97-464a-9737-454df671b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-5316360e-237d-444c-bbca-33aa7178fd10-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "cinder-50f6d790-e5b4-4544-8849-6d8b1e2943ff-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-bac31d78-2265-491a-b9a5-0ba56faa2288 tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-5316360e-237d-444c-bbca-33aa7178fd10-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-50f6d790-e5b4-4544-8849-6d8b1e2943ff" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-50f6d790-e5b4-4544-8849-6d8b1e2943ff" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "cinder-quobyte-5316360e-237d-444c-bbca-33aa7178fd10" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-5316360e-237d-444c-bbca-33aa7178fd10" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee9b53-e9cb-4b6f-bace-7d87063c304f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[404834f1-ddef-43ee-9093-78cbb6136948]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:19 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff Nov 04 19:07:19 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:19 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 Nov 04 19:07:19 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:19 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10" returned: 0 in 0.383s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:19 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff" returned: 0 in 0.411s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:19 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10 Nov 04 19:07:19 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:19 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff Nov 04 19:07:20 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:20 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5316360e-237d-444c-bbca-33aa7178fd10" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:20 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50f6d790-e5b4-4544-8849-6d8b1e2943ff" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-quobyte-5316360e-237d-444c-bbca-33aa7178fd10" released by "delete_volume" :: held 0.716s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-50f6d790-e5b4-4544-8849-6d8b1e2943ff" released by "delete_volume" :: held 0.761s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Created reservations ['684d0a6a-0932-4926-83c7-fe28951da6b5', '5ea39593-6ad7-41bc-9eae-e5553ebc233b', '32eeeb30-9c69-4b2e-9c12-d7493986a04e', '928fdbca-247f-46e3-b471-02105307b751'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Created reservations ['f9dd337a-45c5-478c-a066-3ea483bf180b', '75f82047-3ce7-40d1-a62b-c88f10390fd8', '4ac9d9a1-0665-495d-9992-541a18be091c', 'cbbd527d-0ea9-4e33-8c8f-1deeb765c74b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:20 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:20 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-627fca62-6018-4755-8fe0-7284ed59d80c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-627fca62-6018-4755-8fe0-7284ed59d80c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:20 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:20 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "cinder-quobyte-627fca62-6018-4755-8fe0-7284ed59d80c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-627fca62-6018-4755-8fe0-7284ed59d80c" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017df06-605a-4485-b8c9-ee2711d39215]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c Nov 04 19:07:21 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:21 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.639s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Deleted volume successfully. Nov 04 19:07:21 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.624s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8160ade2-15fe-4b3c-90dd-40222cc0ce36 tempest-VolumesTestJSON-1850383284 None] Lock "cinder-5316360e-237d-444c-bbca-33aa7178fd10-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4a340b8e-abb1-41a1-9e38-eccfe224b758 tempest-VolumesGetTest-1947944500 None] Lock "cinder-50f6d790-e5b4-4544-8849-6d8b1e2943ff-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (aca67987-1003-459f-bc25-6e04c70c2a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fbd108-5ce9-432f-81a7-be5a1bbcdeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c" returned: 0 in 0.833s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fbd108-5ce9-432f-81a7-be5a1bbcdeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1893053757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387a1a80-d65d-430d-afd6-503e3ef20f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:22Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c Nov 04 19:07:21 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855df0ec-06e8-4e34-97ce-73d8f60312f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855df0ec-06e8-4e34-97ce-73d8f60312f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dcc66d-a1c8-446a-9eac-6bf22428bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dcc66d-a1c8-446a-9eac-6bf22428bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387a1a80-d65d-430d-afd6-503e3ef20f58', 'volume_name': 'volume-387a1a80-d65d-430d-afd6-503e3ef20f58', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc017a7-e843-4348-902d-6eda1545a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc017a7-e843-4348-902d-6eda1545a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eda4f0f-502b-4458-a3ff-0a923851d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Volume 387a1a80-d65d-430d-afd6-503e3ef20f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387a1a80-d65d-430d-afd6-503e3ef20f58', 'volume_size': 1} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1893053757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387a1a80-d65d-430d-afd6-503e3ef20f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:22Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Creating volume 387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:21 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:21 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 1073741824 Nov 04 19:07:21 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:21 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-627fca62-6018-4755-8fe0-7284ed59d80c" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-quobyte-627fca62-6018-4755-8fe0-7284ed59d80c" released by "delete_volume" :: held 1.239s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Created reservations ['3c383ed2-6cda-4039-a501-d26203c10a3f', '7137aed7-4238-4b64-bf6a-ee52ca0f9064', 'fd24340f-f1e1-41a5-a517-b486b263d377', 'de9873a2-6983-4222-b8e6-761366be4584'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:22 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:22 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:22 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:22 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:22 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 1073741824" returned: 0 in 0.745s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:22 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.471s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:07:22 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:22 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:22 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.502s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Deleted volume successfully. Nov 04 19:07:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fcabb225-cbfd-4fac-854d-2884fb56af69 tempest-VolumesActionsTest-2079770481 None] Lock "cinder-627fca62-6018-4755-8fe0-7284ed59d80c-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:23 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.483s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eda4f0f-502b-4458-a3ff-0a923851d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387a1a80-d65d-430d-afd6-503e3ef20f58', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed10850-679e-46fc-b307-62a9ce7128a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Volume volume-387a1a80-d65d-430d-afd6-503e3ef20f58 (387a1a80-d65d-430d-afd6-503e3ef20f58): created successfully Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed10850-679e-46fc-b307-62a9ce7128a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (aca67987-1003-459f-bc25-6e04c70c2a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c14eb772-830e-46c1-90bc-79396eb03b3a tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (c71a83c7-a552-4dd2-a19e-66c9ccf1bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a5db52-3f04-44ad-a66e-1b2e272a7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a5db52-3f04-44ad-a66e-1b2e272a7328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1530399337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fda9b6d-64fb-4418-8f80-9ca84912eccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:24Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864fb785-28a5-4e3b-bedf-a1dbcbc1f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864fb785-28a5-4e3b-bedf-a1dbcbc1f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77355ad9-1daa-4f27-9b12-2ed858d14db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77355ad9-1daa-4f27-9b12-2ed858d14db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fda9b6d-64fb-4418-8f80-9ca84912eccb', 'volume_name': 'volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac6e4fa-6ab8-4903-8b5f-4c543a81b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac6e4fa-6ab8-4903-8b5f-4c543a81b75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eea303d-eccb-429d-aee6-c5df3d9a08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:23 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Volume 1fda9b6d-64fb-4418-8f80-9ca84912eccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb', 'volume_size': 1} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1530399337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fda9b6d-64fb-4418-8f80-9ca84912eccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785cc2d009f4f6ab1189c47d61bf584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:24Z,use_quota=True,user_id='18d8e559a7d44b678557e3f4e5813e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Creating volume 1fda9b6d-64fb-4418-8f80-9ca84912eccb {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:23 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:23 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb 1073741824 Nov 04 19:07:23 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (53b57383-ad71-4c4a-8410-4176a954be79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f899a2-0c7b-45af-b23f-331b846fc633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f899a2-0c7b-45af-b23f-331b846fc633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2043254649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88a0c02-7721-4d09-9dc8-1d63a4135396,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=387a1a80-d65d-430d-afd6-503e3ef20f58,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:24Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2f47b8-a522-4c5d-b2d1-09b5abdf95a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2f47b8-a522-4c5d-b2d1-09b5abdf95a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6908cc-d7e1-40aa-80a1-42cd213e884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb 1073741824" returned: 0 in 0.634s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6908cc-d7e1-40aa-80a1-42cd213e884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b88a0c02-7721-4d09-9dc8-1d63a4135396', 'volume_name': 'volume-b88a0c02-7721-4d09-9dc8-1d63a4135396', 'volume_size': 1, 'source_volid': '387a1a80-d65d-430d-afd6-503e3ef20f58', 'source_volstatus': 'available'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c7c89f-6b46-47d4-848c-c52547355c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c7c89f-6b46-47d4-848c-c52547355c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad566841-b374-48cc-b650-0409905d2114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Volume b88a0c02-7721-4d09-9dc8-1d63a4135396: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b88a0c02-7721-4d09-9dc8-1d63a4135396', 'volume_size': 1, 'source_volid': '387a1a80-d65d-430d-afd6-503e3ef20f58', 'source_volstatus': 'available'} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb Nov 04 19:07:24 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.287s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:24 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Cloning volume 387a1a80-d65d-430d-afd6-503e3ef20f58 to volume b88a0c02-7721-4d09-9dc8-1d63a4135396 Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eea303d-eccb-429d-aee6-c5df3d9a08e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa8f2f-7051-44c8-afc3-63bc73c021a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Volume volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb (1fda9b6d-64fb-4418-8f80-9ca84912eccb): created successfully Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafa8f2f-7051-44c8-afc3-63bc73c021a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Flow 'volume_create_manager' (c71a83c7-a552-4dd2-a19e-66c9ccf1bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Creating offline snapshot 91119f35-9b83-42ff-8e49-c400ee1f6d6c of volume 387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a829d8fa-ba5d-40ba-bc88-27af829da0f7 tempest-VolumesActionsTest-537525263 None] Created volume successfully. Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[98852fa8-b736-4c97-a07e-376df6c409cb]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:25 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.410s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c 1G Nov 04 19:07:25 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:25 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c 1G" returned: 0 in 0.466s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387a1a80-d65d-430d-afd6-503e3ef20f58 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:25 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387a1a80-d65d-430d-afd6-503e3ef20f58 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:25 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387a1a80-d65d-430d-afd6-503e3ef20f58 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:26 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c is being set with open permissions: ugo+rw Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:26 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:26 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-1fda9b6d-64fb-4418-8f80-9ca84912eccb-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "cinder-1fda9b6d-64fb-4418-8f80-9ca84912eccb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:26 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Acquiring lock "cinder-quobyte-1fda9b6d-64fb-4418-8f80-9ca84912eccb" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "cinder-quobyte-1fda9b6d-64fb-4418-8f80-9ca84912eccb" acquired by "delete_volume" :: waited 0.040s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:26 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info Nov 04 19:07:26 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a387235-062b-465d-8090-a793ccf69d74]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9b6213f6-b068-405f-8adc-873c26ff8c60 tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-379404495: creating Nov 04 19:07:26 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb Nov 04 19:07:26 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9b6213f6-b068-405f-8adc-873c26ff8c60 tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-379404495: created successfully Nov 04 19:07:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9b6213f6-b068-405f-8adc-873c26ff8c60 tempest-GroupSnapshotsTest-1390717477 None] Create group completed successfully. Nov 04 19:07:26 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info" returned: 0 in 0.320s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:26 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info is being set with open permissions: ugo+rw Nov 04 19:07:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:26 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info Nov 04 19:07:26 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb" returned: 0 in 0.378s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb Nov 04 19:07:27 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.info" returned: 0 in 0.251s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] snapshot: 91119f35-9b83-42ff-8e49-c400ee1f6d6c, volume: b88a0c02-7721-4d09-9dc8-1d63a4135396, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[16818eea-6e26-4acd-80ee-594b26f4c07e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1fda9b6d-64fb-4418-8f80-9ca84912eccb" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "cinder-quobyte-1fda9b6d-64fb-4418-8f80-9ca84912eccb" released by "delete_volume" :: held 0.702s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Created reservations ['9cc17877-3c30-4fbc-a178-ea9d2701ea78', 'fe151286-2a5d-4255-8b4a-f400412188d9', '3e016721-fcfb-4ddf-99a5-be4fcf74a5b0', 'db0a5a2b-e4d9-4847-8fd3-493467f32d06'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:27 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:27 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:27 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:27 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.257s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387a1a80-d65d-430d-afd6-503e3ef20f58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Deleted volume successfully. Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d68d03-5f3f-4404-adc7-37ab73acbac7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7e0ba2ef-35d1-47bb-8fb7-5910b67c5eee tempest-VolumesActionsTest-537525263 None] Lock "cinder-1fda9b6d-64fb-4418-8f80-9ca84912eccb-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:27 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:27 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.420s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:28 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 Nov 04 19:07:28 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (39426a5d-8438-486d-97d5-61ed91699e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e75e1e-9da7-45fb-9e3f-985df783e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e75e1e-9da7-45fb-9e3f-985df783e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939737363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1281f999-bfbd-486b-95c8-dca2ea250871,host='devstack@QuobyteHD#QuobyteHD',id=9c2db5d6-098f-4e20-bba8-aa0a47972ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4e9ddd4-8e24-4a53-a4de-0444aea19ea9),volume_type_id=e4e9ddd4-8e24-4a53-a4de-0444aea19ea9)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9250e033-5a79-4c84-a7c8-00d21986108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9250e033-5a79-4c84-a7c8-00d21986108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6301912c-d1eb-4e65-b835-717db41a3b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6301912c-d1eb-4e65-b835-717db41a3b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2db5d6-098f-4e20-bba8-aa0a47972ff9', 'volume_name': 'volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b70a14a-8c80-45ed-bba5-b4ba8dc2da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b70a14a-8c80-45ed-bba5-b4ba8dc2da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804d3d0-d6fc-4293-b906-ea27be3831de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:28 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Volume 9c2db5d6-098f-4e20-bba8-aa0a47972ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9', 'volume_size': 1} Nov 04 19:07:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Flow 'volume_create_manager' (ad19c231-b7db-4527-a725-d978e92719a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c267c4b-6043-460c-9baf-73552730e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c267c4b-6043-460c-9baf-73552730e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-359255980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddded8c-0cff-4467-b827-f29a1d73b056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163faaad0e1c4dc091d7e6dadc27f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:36Z,use_quota=True,user_id='5bdcbc9f2b22444c9abf7e89bb9f8f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f556a79-a121-4a8f-9d07-996ebbf41199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f556a79-a121-4a8f-9d07-996ebbf41199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110ba854-2f36-4a1d-8f1d-8a149c1c675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110ba854-2f36-4a1d-8f1d-8a149c1c675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddded8c-0cff-4467-b827-f29a1d73b056', 'volume_name': 'volume-bddded8c-0cff-4467-b827-f29a1d73b056', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f35252-314a-4801-8f19-37dc6cc618fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f35252-314a-4801-8f19-37dc6cc618fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2ae556-079a-4cc2-a5a0-ad691315583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:36 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Volume bddded8c-0cff-4467-b827-f29a1d73b056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddded8c-0cff-4467-b827-f29a1d73b056', 'volume_size': 1} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:36 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396" returned: 0 in 8.468s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:07:36 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Converted 1024.00 MB image at 120.91 MB/s Nov 04 19:07:36 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 is being set with open permissions: ugo+rw Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 Nov 04 19:07:36 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" released by "_copy_volume_from_snapshot" :: held 9.691s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-91119f35-9b83-42ff-8e49-c400ee1f6d6c" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-91119f35-9b83-42ff-8e49-c400ee1f6d6c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Deleting offline snapshot 91119f35-9b83-42ff-8e49-c400ee1f6d6c of volume 387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] snapshot_file for this snap is: volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ea1a2-776e-4865-979b-ce8d85fea15b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:37 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387a1a80-d65d-430d-afd6-503e3ef20f58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950aac0-5eca-44ed-88b3-373f6cc0f5a8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:37 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.606s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:38 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c Nov 04 19:07:38 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58.91119f35-9b83-42ff-8e49-c400ee1f6d6c" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-91119f35-9b83-42ff-8e49-c400ee1f6d6c" released by "_delete_snapshot" :: held 1.807s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.888s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.239s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1281f999-bfbd-486b-95c8-dca2ea250871,created_at=2026-11-04T18:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939737363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1281f999-bfbd-486b-95c8-dca2ea250871,host='devstack@QuobyteHD#QuobyteHD',id=9c2db5d6-098f-4e20-bba8-aa0a47972ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:28Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4e9ddd4-8e24-4a53-a4de-0444aea19ea9),volume_type_id=e4e9ddd4-8e24-4a53-a4de-0444aea19ea9)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Creating volume 9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:38 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad566841-b374-48cc-b650-0409905d2114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88a0c02-7721-4d09-9dc8-1d63a4135396', 'volume_size': 1, 'source_volid': '387a1a80-d65d-430d-afd6-503e3ef20f58', 'source_volstatus': 'available'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36ca20-96c2-4e40-b328-f5f9a9015dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:38 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 1073741824 Nov 04 19:07:38 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Volume volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 (b88a0c02-7721-4d09-9dc8-1d63a4135396): created successfully Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36ca20-96c2-4e40-b328-f5f9a9015dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (53b57383-ad71-4c4a-8410-4176a954be79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c8af1dea-c805-46d9-92be-27041e383ee5 tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:07:39 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 1073741824" returned: 0 in 0.494s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=143,cinder:INSERT=48,cinder:UPDATE=175,cinder:DELETE=17 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:07:39 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-359255980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddded8c-0cff-4467-b827-f29a1d73b056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163faaad0e1c4dc091d7e6dadc27f3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:36Z,use_quota=True,user_id='5bdcbc9f2b22444c9abf7e89bb9f8f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Creating volume bddded8c-0cff-4467-b827-f29a1d73b056 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:39 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:39 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 1073741824 Nov 04 19:07:39 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3804d3d0-d6fc-4293-b906-ea27be3831de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ffd359-1f0e-40ec-8aac-1b7deb4cf50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Volume volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 (9c2db5d6-098f-4e20-bba8-aa0a47972ff9): created successfully Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ffd359-1f0e-40ec-8aac-1b7deb4cf50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (39426a5d-8438-486d-97d5-61ed91699e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-512af94c-603f-41f7-be61-36d1b28b0e65 tempest-GroupSnapshotsTest-1390717477 None] Created volume successfully. Nov 04 19:07:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 1073741824" returned: 0 in 0.649s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 Nov 04 19:07:40 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] GroupSnapshot d76182a2-66de-4e09-878d-f9be83a040c6: creating. Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Group snapshot d76182a2-66de-4e09-878d-f9be83a040c6: creating. {{(pid=87367) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:40 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056" returned: 0 in 0.333s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.070s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Creating offline snapshot 7835e2e4-43b2-4dc6-a666-f5178516a3eb of volume 9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2ae556-079a-4cc2-a5a0-ad691315583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddded8c-0cff-4467-b827-f29a1d73b056', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40655ce1-d1c8-4e7b-8b98-899d1198b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:40 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Volume volume-bddded8c-0cff-4467-b827-f29a1d73b056 (bddded8c-0cff-4467-b827-f29a1d73b056): created successfully Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40655ce1-d1c8-4e7b-8b98-899d1198b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Flow 'volume_create_manager' (ad19c231-b7db-4527-a725-d978e92719a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5b19c-9614-4823-a213-82fc6d301d69]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b5b87318-e2e0-4fed-bf47-a75764dafebb tempest-AttachVolumeShelveTestJSON-1448560739 None] Created volume successfully. Nov 04 19:07:40 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:07:40 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (870acd51-4ee4-4fd8-8840-b83eadb2ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dc7d0a-658d-4fb7-b607-7f76ba328628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8dc7d0a-658d-4fb7-b607-7f76ba328628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2064525501',display_name='tempest-VolumesGetTest-Volume-1190224812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a7423a-3b50-4eba-a727-b7314f1fe5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:41Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202a30e-87c6-4ea1-bb01-711348281d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c202a30e-87c6-4ea1-bb01-711348281d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b3cbe3-e5f8-42e9-b5c8-68f7be95df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b3cbe3-e5f8-42e9-b5c8-68f7be95df95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a7423a-3b50-4eba-a727-b7314f1fe5a8', 'volume_name': 'volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019377e6-2b19-4c5c-b2dc-1a3bc80a7050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019377e6-2b19-4c5c-b2dc-1a3bc80a7050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394242b-2188-458f-aaf0-66749c73df27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:41 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Volume 55a7423a-3b50-4eba-a727-b7314f1fe5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8', 'volume_size': 1} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:41 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.478s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb 1G Nov 04 19:07:41 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:41 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb 1G" returned: 0 in 0.544s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:41 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:07:41 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.338s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:07:42 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.283s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info Nov 04 19:07:42 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:42 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info" returned: 0 in 0.284s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:42 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:07:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:42 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info Nov 04 19:07:42 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:43 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.info" returned: 0 in 0.326s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2064525501',display_name='tempest-VolumesGetTest-Volume-1190224812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a7423a-3b50-4eba-a727-b7314f1fe5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:41Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Creating volume 55a7423a-3b50-4eba-a727-b7314f1fe5a8 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:43 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:43 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 1073741824 Nov 04 19:07:43 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-53053eae-c5a5-46e2-ab46-28e6811cb0df tempest-GroupSnapshotsTest-1390717477 None] group_snapshot d76182a2-66de-4e09-878d-f9be83a040c6: created successfully Nov 04 19:07:43 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 1073741824" returned: 0 in 0.692s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:43 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 Nov 04 19:07:43 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:44 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394242b-2188-458f-aaf0-66749c73df27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409f50f3-2f6c-435f-82af-a25eb77949d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Volume volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 (55a7423a-3b50-4eba-a727-b7314f1fe5a8): created successfully Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409f50f3-2f6c-435f-82af-a25eb77949d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (870acd51-4ee4-4fd8-8840-b83eadb2ae18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-38aaaf68-1be0-4f6b-9510-67163843093f tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb-7350338f-de8e-4cb0-a033-fec9a5a6792a" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb-7350338f-de8e-4cb0-a033-fec9a5a6792a" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Creating volume 7350338f-de8e-4cb0-a033-fec9a5a6792a from snapshot 7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] snapshot: 7835e2e4-43b2-4dc6-a666-f5178516a3eb, volume: 7350338f-de8e-4cb0-a033-fec9a5a6792a, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3439fbce-2206-4621-881e-820f52e82be1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:45 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:07:45 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-55a7423a-3b50-4eba-a727-b7314f1fe5a8-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "cinder-55a7423a-3b50-4eba-a727-b7314f1fe5a8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-55a7423a-3b50-4eba-a727-b7314f1fe5a8" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-55a7423a-3b50-4eba-a727-b7314f1fe5a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:45 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.543s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[18353940-b1a6-4818-8e05-09cf7f661d87]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d239529-b945-443d-a054-46f8ff2e5984]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:46 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 Nov 04 19:07:46 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:07:46 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:46 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:46 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8" returned: 0 in 0.534s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:46 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.544s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:46 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8 Nov 04 19:07:46 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:46 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a Nov 04 19:07:46 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:46 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-55a7423a-3b50-4eba-a727-b7314f1fe5a8" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-55a7423a-3b50-4eba-a727-b7314f1fe5a8" released by "delete_volume" :: held 0.881s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Created reservations ['1c94a794-6cfa-4226-8dc8-cc56fea928d7', 'bce00ba1-4eb4-41a9-9fcb-3c1040fe5a78', 'a28e1dff-c42e-4ccc-a923-a8ee96fcbd0c', '3d333911-358b-47c4-b364-a76e9968ab4b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:47 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:47 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-b88a0c02-7721-4d09-9dc8-1d63a4135396-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "cinder-b88a0c02-7721-4d09-9dc8-1d63a4135396-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:47 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.561s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-aa3c93f4-3b17-460d-9ffc-c7f9fc3e249f tempest-VolumesGetTest-1947944500 None] Lock "cinder-55a7423a-3b50-4eba-a727-b7314f1fe5a8-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" acquired by "delete_volume" :: waited 0.046s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f94424-182a-478b-8092-ca0ec9c89818]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:48 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 Nov 04 19:07:48 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Flow 'volume_create_manager' (7d3db71d-b93f-4698-913d-b25e35631cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9520705-bce8-4d8a-83b0-e923dce80908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9520705-bce8-4d8a-83b0-e923dce80908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1079900421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09529488-6d57-499f-bda8-ba384c4190ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf14e3775c4c31b4a4572dc3665270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:49Z,use_quota=True,user_id='03d66f4704254b289265b5bc2fcab4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:48 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54187017-d906-4603-a838-352ddb96768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54187017-d906-4603-a838-352ddb96768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e4c51-04c4-4421-b19b-237bafb56ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396" returned: 0 in 0.957s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:48 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396 Nov 04 19:07:48 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:49 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b88a0c02-7721-4d09-9dc8-1d63a4135396" returned: 0 in 0.512s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-b88a0c02-7721-4d09-9dc8-1d63a4135396" released by "delete_volume" :: held 1.591s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9e4c51-04c4-4421-b19b-237bafb56ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09529488-6d57-499f-bda8-ba384c4190ba', 'volume_name': 'volume-09529488-6d57-499f-bda8-ba384c4190ba', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c9b19-8348-456b-82b8-473a54bc603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c9b19-8348-456b-82b8-473a54bc603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e443a1-c0bd-4282-9b8d-f933321e7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:49 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Volume 09529488-6d57-499f-bda8-ba384c4190ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09529488-6d57-499f-bda8-ba384c4190ba', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Trying to clone 09529488-6d57-499f-bda8-ba384c4190ba from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Created reservations ['b029fb16-72e6-4891-9249-fb297078636b', '8e4b30df-ecd9-463c-9a32-174eeb26ddba', 'e657cae3-120a-4c67-b1bb-7073c6ddb4e5', 'cdd8dcb6-a455-42fd-b3cf-e069b01fd1b1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:49 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:49 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:50 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-387a1a80-d65d-430d-afd6-503e3ef20f58-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.641s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "cinder-387a1a80-d65d-430d-afd6-503e3ef20f58-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD, size 20.69 MB, duration 1.05 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:07:50 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Image download 20.69 MB at 19.72 MB/s Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1ba3641e-ddc5-4994-b660-fa1589ab4206 tempest-VolumesGetTest-1947944500 None] Lock "cinder-b88a0c02-7721-4d09-9dc8-1d63a4135396-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-387a1a80-d65d-430d-afd6-503e3ef20f58" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cd7ad-1752-4ded-9f04-e64b8dd0d2da]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-387a1a80-d65d-430d-afd6-503e3ef20f58" acquired by "delete_volume" :: waited 0.059s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea9ef7-144f-4867-88cb-7d3936dd8aa8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:51 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD Nov 04 19:07:51 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:51 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:51 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:51 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 is fetched for user 03d66f4704254b289265b5bc2fcab4fe. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc30ef-7acf-4df4-9611-f8fd0a7df26a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:51 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.935s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:51 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD Nov 04 19:07:51 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:51 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58 Nov 04 19:07:51 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:52 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:52 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-387a1a80-d65d-430d-afd6-503e3ef20f58" returned: 0 in 0.491s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-387a1a80-d65d-430d-afd6-503e3ef20f58" released by "delete_volume" :: held 1.568s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:53 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Created reservations ['ff0fef22-cd7f-4152-a967-6155255d021e', '4c5e8c22-d5b7-4a8b-83f3-1606c90397be', 'e9c12f74-85a1-4d2e-a89f-aa6448fc282f', '90bd85ec-5dae-45fb-b306-9a23ebf42f2f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:55 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:55 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:55 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a" returned: 0 in 9.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:07:55 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Converted 1024.00 MB image at 109.29 MB/s Nov 04 19:07:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:55 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a Nov 04 19:07:55 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:55 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.533s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:55 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:07:56 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a" returned: 0 in 0.306s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" released by "_copy_volume_from_snapshot" :: held 10.942s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b45a8c1-1581-407c-ac43-6042a62f6a50 tempest-VolumesGetTest-1947944500 None] Lock "cinder-387a1a80-d65d-430d-afd6-503e3ef20f58-delete_volume" released by "delete_volume" :: held 6.830s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb-7350338f-de8e-4cb0-a033-fec9a5a6792a" released by "_create_volume_from_snapshot" :: held 12.163s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.209s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.070s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1079900421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09529488-6d57-499f-bda8-ba384c4190ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf14e3775c4c31b4a4572dc3665270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:49Z,use_quota=True,user_id='03d66f4704254b289265b5bc2fcab4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Creating volume 09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:57 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:57 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1073741824 Nov 04 19:07:57 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cb680b02-5f16-4a82-b228-29ed18244c62 tempest-GroupSnapshotsTest-1390717477 None] Create group from source-snapshot-d76182a2-66de-4e09-878d-f9be83a040c6 completed successfully. Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (66d9be87-2fa4-4976-9439-f633b2f57de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18abee0-b985-492f-a10b-ee746fab212a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18abee0-b985-492f-a10b-ee746fab212a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1192220337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635e4071-1280-44d6-a241-cbd9c3b2e073,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:58Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c98a03-de96-4a92-8df2-3cb38247aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c98a03-de96-4a92-8df2-3cb38247aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8a6d9-0bdd-4459-b0dd-6e3504dd1ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:57 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:07:58 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1073741824" returned: 0 in 0.616s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba Nov 04 19:07:58 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d8a6d9-0bdd-4459-b0dd-6e3504dd1ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '635e4071-1280-44d6-a241-cbd9c3b2e073', 'volume_name': 'volume-635e4071-1280-44d6-a241-cbd9c3b2e073', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedd00a8-ec17-42a7-a36b-11b728f5a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedd00a8-ec17-42a7-a36b-11b728f5a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89926cc0-5be1-45cd-8a28-f0876be3eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Volume 635e4071-1280-44d6-a241-cbd9c3b2e073: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-635e4071-1280-44d6-a241-cbd9c3b2e073', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Trying to clone 635e4071-1280-44d6-a241-cbd9c3b2e073 from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af03b0-c59f-4d94-8d15-2135d965fe64]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:58 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a Nov 04 19:07:58 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Attempting download of 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 09529488-6d57-499f-bda8-ba384c4190ba. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:07:58 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a8196-66d0-448e-94e0-91eb9a3e1300]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef9cb2-e31a-40a1-9bc7-af3983363f01]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p Nov 04 19:07:58 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:58 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD Nov 04 19:07:58 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:58 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a" returned: 0 in 0.628s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a Nov 04 19:07:58 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 is fetched for user 97df6e392fbd4642b72f9d6e125b37c8. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac719df0-2502-465b-9ef0-23005e0a35a1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7350338f-de8e-4cb0-a033-fec9a5a6792a" returned: 0 in 0.298s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p Nov 04 19:07:59 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7350338f-de8e-4cb0-a033-fec9a5a6792a" released by "delete_volume" :: held 1.002s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['3df4772b-7c7d-4ff9-aa02-67c28d105299'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:59 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD Nov 04 19:07:59 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack cinder-volume[87367]: WARNING cinder.quota [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-535561139 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-535561139, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:07:59 devstack cinder-volume[87367]: WARNING cinder.quota [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-535561139 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-535561139, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['2a6a402a-a3d3-4fe5-947f-35cee4fa46b4', 'ef0d8dff-eddb-4ebf-9730-9da83770e9c3', 'f8eec497-9c1c-4146-8dfb-9ba872787804', '2ced2888-9bdf-4673-b52b-b713aae737ac'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:59 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p" returned: 1 in 0.529s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6__l_7bj_p' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[145f517a-6690-4f5d-b494-8e78324c4f09]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:07:59 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1192220337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635e4071-1280-44d6-a241-cbd9c3b2e073,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:58Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Creating volume 635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:59 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1073741824 Nov 04 19:07:59 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD Nov 04 19:07:59 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.340s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ff6cdf57-1215-4878-9c1c-11beb9c43685 tempest-GroupSnapshotsTest-1390717477 None] Delete group completed successfully. Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-4e78cdaa-fc86-45d2-856c-a834a4970f89 req-76127988-e031-4d58-b818-0b6433a40bcb tempest-AttachVolumeShelveTestJSON-1448560739 None] No connector for attachment 5dbe6ed5-8db1-4973-bf46-6be6be87af92; skipping storage backend terminate_connection call. {{(pid=87367) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 19:07:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-4e78cdaa-fc86-45d2-856c-a834a4970f89 req-76127988-e031-4d58-b818-0b6433a40bcb tempest-AttachVolumeShelveTestJSON-1448560739 None] Deleting attachment 5dbe6ed5-8db1-4973-bf46-6be6be87af92. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:08:00 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] 4ddc0397-cfae-4b65-9580-9560490b2ca6 was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba Nov 04 19:08:00 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1073741824" returned: 0 in 0.518s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 Nov 04 19:08:00 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073" returned: 0 in 0.280s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Attempting download of 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 635e4071-1280-44d6-a241-cbd9c3b2e073. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7728b9-dba0-4019-8d2e-608cb7af19c5]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_ {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot d76182a2-66de-4e09-878d-f9be83a040c6: deleting Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot d76182a2-66de-4e09-878d-f9be83a040c6: deleting {{(pid=87367) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:00 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_ Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:00 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Deleting offline snapshot 7835e2e4-43b2-4dc6-a666-f5178516a3eb of volume 9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] snapshot_file for this snap is: volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c46aac9-ac0b-4a44-a07a-45e3675cd25d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:08:01 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_" returned: 0 in 0.627s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_ {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_ Nov 04 19:08:01 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.595s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[599338e7-a319-44eb-a897-3a19a52fcff1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:08:01 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_" returned: 1 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_w1mjsyy_' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6d49a4-048a-44ac-8d6c-be3c93d6fdb7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD Nov 04 19:08:01 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] 4ddc0397-cfae-4b65-9580-9560490b2ca6 was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.725s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 Nov 04 19:08:02 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:08:02 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba" returned: 0 in 2.585s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_2lfheasgdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:08:02 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Converted 112.00 MB image at 43.29 MB/s Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1G Nov 04 19:08:02 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.478s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb Nov 04 19:08:02 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:03 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba 1G" returned: 0 in 0.378s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Downloaded image 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 09529488-6d57-499f-bda8-ba384c4190ba successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 for user 03d66f4704254b289265b5bc2fcab4fe is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Marking volume 09529488-6d57-499f-bda8-ba384c4190ba as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Copying metadata from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 to 09529488-6d57-499f-bda8-ba384c4190ba. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Creating volume glance metadata for volume 09529488-6d57-499f-bda8-ba384c4190ba backed by image 4ddc0397-cfae-4b65-9580-9560490b2ca6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:08:03 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9.7835e2e4-43b2-4dc6-a666-f5178516a3eb" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-7835e2e4-43b2-4dc6-a666-f5178516a3eb" released by "_delete_snapshot" :: held 2.294s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" released by "delete_snapshot" :: held 2.351s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e443a1-c0bd-4282-9b8d-f933321e7284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09529488-6d57-499f-bda8-ba384c4190ba', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262c4143-9520-4bde-a7a4-afe4e0c7c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:03 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Volume volume-09529488-6d57-499f-bda8-ba384c4190ba (09529488-6d57-499f-bda8-ba384c4190ba): created successfully Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262c4143-9520-4bde-a7a4-afe4e0c7c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Flow 'volume_create_manager' (7d3db71d-b93f-4698-913d-b25e35631cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b488a334-ed7e-40b1-93ac-fe88833c8534 tempest-VolumesImageMetadata-245983471 None] Created volume successfully. Nov 04 19:08:03 devstack cinder-volume[87367]: WARNING cinder.quota [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-535561139 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-535561139, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['466e6f7a-5129-4498-bb50-729d716b787f', 'ce17d517-f018-46cb-a8c1-1d74276655ca', 'f3515c38-6588-40ff-9588-452bf8ffad7c', '4d318102-660a-4ac2-98ab-14d8a62ec2e4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-df3caf55-1b5f-4b1c-94f1-c584eded9784 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot d76182a2-66de-4e09-878d-f9be83a040c6: deleted successfully Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Acquiring lock "cinder-09529488-6d57-499f-bda8-ba384c4190ba-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "cinder-09529488-6d57-499f-bda8-ba384c4190ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Acquiring lock "cinder-quobyte-09529488-6d57-499f-bda8-ba384c4190ba" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "cinder-quobyte-09529488-6d57-499f-bda8-ba384c4190ba" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae829dfb-31b0-44ef-8c55-4e58ae7025bf]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:04 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073" returned: 0 in 2.555s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_6yjesxf2devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:08:04 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Converted 112.00 MB image at 43.82 MB/s Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" acquired by "delete_volume" :: waited 0.047s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:04 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1G Nov 04 19:08:04 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba Nov 04 19:08:04 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086b7d8-050a-4236-9b3b-6697a1750792]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:08:05 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 1G" returned: 0 in 0.564s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Downloaded image 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 635e4071-1280-44d6-a241-cbd9c3b2e073 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:08:05 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 for user 97df6e392fbd4642b72f9d6e125b37c8 is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Marking volume 635e4071-1280-44d6-a241-cbd9c3b2e073 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba" returned: 0 in 0.643s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Copying metadata from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 to 635e4071-1280-44d6-a241-cbd9c3b2e073. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Creating volume glance metadata for volume 635e4071-1280-44d6-a241-cbd9c3b2e073 backed by image 4ddc0397-cfae-4b65-9580-9560490b2ca6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:08:05 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba Nov 04 19:08:05 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.618s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89926cc0-5be1-45cd-8a28-f0876be3eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635e4071-1280-44d6-a241-cbd9c3b2e073', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e649d1bd-4b2f-4de6-9866-642d043a269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:05 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9 Nov 04 19:08:05 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Volume volume-635e4071-1280-44d6-a241-cbd9c3b2e073 (635e4071-1280-44d6-a241-cbd9c3b2e073): created successfully Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e649d1bd-4b2f-4de6-9866-642d043a269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (66d9be87-2fa4-4976-9439-f633b2f57de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-31511967-efe1-4717-96a3-57a5a6612527 tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:08:05 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-09529488-6d57-499f-bda8-ba384c4190ba" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "cinder-quobyte-09529488-6d57-499f-bda8-ba384c4190ba" released by "delete_volume" :: held 1.086s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Created reservations ['2e0a83b6-30db-4959-b00f-ff709360e880', '25051f48-169d-4373-9b3f-13ccae9220b0', '126a2466-23a8-4d4b-befe-17dff97c9605', 'de971788-81ee-446a-a8e2-1507e1fad561'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:05 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" returned: 0 in 0.332s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-9c2db5d6-098f-4e20-bba8-aa0a47972ff9" released by "delete_volume" :: held 1.120s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:06 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:06 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['ef67dd36-1740-49f7-9ab7-64974afd22da'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:06 devstack cinder-volume[87367]: WARNING cinder.db.api [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-535561139'] Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['43c34e67-0614-46b0-b938-3a36c5980974', 'b7d77792-b471-412b-9a6e-e5d70fbd5481', 'b6502650-08ae-407a-9455-2399e7ec3fff', '8e61f1db-9fb1-4206-a249-7dabbcd8076d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:06 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:06 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:06 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.408s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Deleted volume successfully. Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c30f39e6-5719-4640-8552-a231e94a440b tempest-VolumesImageMetadata-245983471 None] Lock "cinder-09529488-6d57-499f-bda8-ba384c4190ba-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:06 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.343s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-724947f7-7107-4fcc-90f9-4854022bb041 tempest-GroupSnapshotsTest-1390717477 None] Delete group completed successfully. Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (a7bcc0eb-6fff-4727-a016-5c7869b4b25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a5cb3f-2436-4938-bd8a-8dadd29c3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a5cb3f-2436-4938-bd8a-8dadd29c3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1629067265',display_name='tempest-VolumesGetTest-Volume-1090582610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4889c452-39ac-411a-b830-3a1bf4541552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:07Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde6f0fe-d980-44bf-8fbb-05da17ff1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde6f0fe-d980-44bf-8fbb-05da17ff1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1650f61-0a1e-4089-a55c-4d1693ef7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1650f61-0a1e-4089-a55c-4d1693ef7add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4889c452-39ac-411a-b830-3a1bf4541552', 'volume_name': 'volume-4889c452-39ac-411a-b830-3a1bf4541552', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d2da7-fa8b-43b8-a335-bf314ab18dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d2da7-fa8b-43b8-a335-bf314ab18dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716900d5-07df-4946-bf00-1869b5def53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Volume 4889c452-39ac-411a-b830-3a1bf4541552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4889c452-39ac-411a-b830-3a1bf4541552', 'volume_size': 1} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1629067265',display_name='tempest-VolumesGetTest-Volume-1090582610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4889c452-39ac-411a-b830-3a1bf4541552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1f8bf50d3e4c83a32787b9de7d7c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:07Z,use_quota=True,user_id='97df6e392fbd4642b72f9d6e125b37c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Creating volume 4889c452-39ac-411a-b830-3a1bf4541552 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:07 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 1073741824 Nov 04 19:08:07 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f97c8550-f3b9-4283-8c8a-eff1257041bd tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-694440144: creating Nov 04 19:08:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f97c8550-f3b9-4283-8c8a-eff1257041bd tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-694440144: created successfully Nov 04 19:08:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f97c8550-f3b9-4283-8c8a-eff1257041bd tempest-GroupSnapshotsTest-1390717477 None] Create group completed successfully. Nov 04 19:08:08 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 1073741824" returned: 0 in 0.634s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:08 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 Nov 04 19:08:08 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716900d5-07df-4946-bf00-1869b5def53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4889c452-39ac-411a-b830-3a1bf4541552', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ad594d-4dac-4db4-bd3e-335e3f350d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Volume volume-4889c452-39ac-411a-b830-3a1bf4541552 (4889c452-39ac-411a-b830-3a1bf4541552): created successfully Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ad594d-4dac-4db4-bd3e-335e3f350d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Flow 'volume_create_manager' (a7bcc0eb-6fff-4727-a016-5c7869b4b25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b300e867-900d-4650-8ce8-d762177d57e5 tempest-VolumesGetTest-1947944500 None] Created volume successfully. Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-4889c452-39ac-411a-b830-3a1bf4541552-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-4889c452-39ac-411a-b830-3a1bf4541552-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-4889c452-39ac-411a-b830-3a1bf4541552" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (2b47ee15-8fdd-48a0-84fa-b679eb2d82be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb45ff19-4fc1-4c24-b67b-9a30e5cd22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-4889c452-39ac-411a-b830-3a1bf4541552" acquired by "delete_volume" :: waited 0.067s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb45ff19-4fc1-4c24-b67b-9a30e5cd22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126652295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ca5a12-d233-4716-8e5e-b53376faedc4,host='devstack@QuobyteHD#QuobyteHD',id=165d5032-b607-45db-84bd-ecf7a8077a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:10Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16c3bc36-86ca-4a0b-96c5-1a1df889eb63),volume_type_id=16c3bc36-86ca-4a0b-96c5-1a1df889eb63)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed252bb8-8f1e-4026-82d8-f9ebaf5180d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed252bb8-8f1e-4026-82d8-f9ebaf5180d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f016207c-6a68-4064-8c41-9a6347bd88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f016207c-6a68-4064-8c41-9a6347bd88b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165d5032-b607-45db-84bd-ecf7a8077a96', 'volume_name': 'volume-165d5032-b607-45db-84bd-ecf7a8077a96', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f855e54c-8e0b-49b6-a3e0-c113ac42f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f855e54c-8e0b-49b6-a3e0-c113ac42f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f351cc5c-0860-4fd7-86ce-5a4a5b6eadea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Volume 165d5032-b607-45db-84bd-ecf7a8077a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165d5032-b607-45db-84bd-ecf7a8077a96', 'volume_size': 1} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88ca5a12-d233-4716-8e5e-b53376faedc4,created_at=2026-11-04T18:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126652295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ca5a12-d233-4716-8e5e-b53376faedc4,host='devstack@QuobyteHD#QuobyteHD',id=165d5032-b607-45db-84bd-ecf7a8077a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:10Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16c3bc36-86ca-4a0b-96c5-1a1df889eb63),volume_type_id=16c3bc36-86ca-4a0b-96c5-1a1df889eb63)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Creating volume 165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:10 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ff144-cd57-4138-93ce-09614a64c43c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:10 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 1073741824 Nov 04 19:08:10 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:10 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 Nov 04 19:08:10 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:10 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552" returned: 0 in 0.643s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:10 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 1073741824" returned: 0 in 0.720s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:10 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552 Nov 04 19:08:10 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:10 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 Nov 04 19:08:10 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:11 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4889c452-39ac-411a-b830-3a1bf4541552" returned: 0 in 0.504s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-4889c452-39ac-411a-b830-3a1bf4541552" released by "delete_volume" :: held 1.312s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Created reservations ['a524c2bd-eae0-4b28-99dd-e762fb10b601', 'c9346240-86fa-4399-a2bf-6623e71388d4', '5571f1ea-682b-4e87-9aa8-ef144624c29d', '53263741-95b2-438b-b85a-b57acad4bb07'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:11 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96" returned: 0 in 0.602s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f351cc5c-0860-4fd7-86ce-5a4a5b6eadea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165d5032-b607-45db-84bd-ecf7a8077a96', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be162ad4-3156-406d-a65f-ee2eaf4f64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Volume volume-165d5032-b607-45db-84bd-ecf7a8077a96 (165d5032-b607-45db-84bd-ecf7a8077a96): created successfully Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be162ad4-3156-406d-a65f-ee2eaf4f64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (2b47ee15-8fdd-48a0-84fa-b679eb2d82be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-324e3d8b-6d6c-4854-82a5-ab992fc466cf tempest-GroupSnapshotsTest-1390717477 None] Created volume successfully. Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:11 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:11 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:12 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.387s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-333057ac-bf3e-48d4-a664-b3c8b09d40b5 tempest-VolumesGetTest-1947944500 None] Lock "cinder-4889c452-39ac-411a-b830-3a1bf4541552-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-635e4071-1280-44d6-a241-cbd9c3b2e073-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "cinder-635e4071-1280-44d6-a241-cbd9c3b2e073-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Acquiring lock "cinder-quobyte-635e4071-1280-44d6-a241-cbd9c3b2e073" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-635e4071-1280-44d6-a241-cbd9c3b2e073" acquired by "delete_volume" :: waited 0.041s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdabdbf6-1138-4479-9ace-8911ea51d8c6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 Nov 04 19:08:13 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Flow 'volume_create_manager' (1fac84a3-ace2-4c69-9be6-cd1b57854b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a37411-a444-4a92-95e5-78955ecb81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a37411-a444-4a92-95e5-78955ecb81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1140616147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc650ab-002f-479d-ba09-772ac40e8a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8a8856f3984072b9aae4618cb501c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:13Z,use_quota=True,user_id='46a6b45126ba4798b0f89e6ca1987201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52049cca-5954-4d81-8de5-941829f13c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52049cca-5954-4d81-8de5-941829f13c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f894cdd-71fc-4f43-a827-0f87254307bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f894cdd-71fc-4f43-a827-0f87254307bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc650ab-002f-479d-ba09-772ac40e8a0b', 'volume_name': 'volume-cdc650ab-002f-479d-ba09-772ac40e8a0b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86818eb-7f7b-4a13-b7a6-d962a71591b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86818eb-7f7b-4a13-b7a6-d962a71591b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bd0c70-3c34-4255-9242-83d0dcc880a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Volume cdc650ab-002f-479d-ba09-772ac40e8a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc650ab-002f-479d-ba09-772ac40e8a0b', 'volume_size': 1} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1140616147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc650ab-002f-479d-ba09-772ac40e8a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8a8856f3984072b9aae4618cb501c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:13Z,use_quota=True,user_id='46a6b45126ba4798b0f89e6ca1987201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Creating volume cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:13 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073" returned: 0 in 0.798s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b 1073741824 Nov 04 19:08:13 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073 Nov 04 19:08:13 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (103aaf31-dc70-4d64-96c9-11e1b40ac9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e18b79c-9ce9-4526-8de3-5f003ef7a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635e4071-1280-44d6-a241-cbd9c3b2e073" returned: 0 in 0.491s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e18b79c-9ce9-4526-8de3-5f003ef7a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029722343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ca5a12-d233-4716-8e5e-b53376faedc4,host='devstack@QuobyteHD#QuobyteHD',id=15b51116-e75a-41da-af45-234962c9d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:14Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16c3bc36-86ca-4a0b-96c5-1a1df889eb63),volume_type_id=16c3bc36-86ca-4a0b-96c5-1a1df889eb63)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9463bb84-9574-409b-a232-5725221b4565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9463bb84-9574-409b-a232-5725221b4565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5114ca38-770e-450b-8f57-156cac4d2226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5114ca38-770e-450b-8f57-156cac4d2226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b51116-e75a-41da-af45-234962c9d845', 'volume_name': 'volume-15b51116-e75a-41da-af45-234962c9d845', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144ef192-fb5f-4046-9c5b-aec7dc82600f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144ef192-fb5f-4046-9c5b-aec7dc82600f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d637390-93a3-40c5-b9ea-3ab747880ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Volume 15b51116-e75a-41da-af45-234962c9d845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b51116-e75a-41da-af45-234962c9d845', 'volume_size': 1} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "cinder-quobyte-635e4071-1280-44d6-a241-cbd9c3b2e073" released by "delete_volume" :: held 1.472s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Created reservations ['323ac5d8-abba-4880-9c2c-9189553647d9', '9d2ec16c-97d8-4f56-87cc-f439a5377d82', '9243880e-5da0-4c7d-a61a-d0646fb246c2', '3bd28eea-1649-4f76-90ab-b17bb11bb30d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:14 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b 1073741824" returned: 0 in 0.727s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:14 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b Nov 04 19:08:14 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:14 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:14 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b" returned: 0 in 0.297s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88ca5a12-d233-4716-8e5e-b53376faedc4,created_at=2026-11-04T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029722343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88ca5a12-d233-4716-8e5e-b53376faedc4,host='devstack@QuobyteHD#QuobyteHD',id=15b51116-e75a-41da-af45-234962c9d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:14Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16c3bc36-86ca-4a0b-96c5-1a1df889eb63),volume_type_id=16c3bc36-86ca-4a0b-96c5-1a1df889eb63)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Creating volume 15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:14 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bd0c70-3c34-4255-9242-83d0dcc880a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc650ab-002f-479d-ba09-772ac40e8a0b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 1073741824 Nov 04 19:08:14 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9e15e6-7cc8-428d-adba-18cf9f136127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Volume volume-cdc650ab-002f-479d-ba09-772ac40e8a0b (cdc650ab-002f-479d-ba09-772ac40e8a0b): created successfully Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9e15e6-7cc8-428d-adba-18cf9f136127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Flow 'volume_create_manager' (1fac84a3-ace2-4c69-9be6-cd1b57854b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2b5f7cc3-d8ed-4d52-ac79-8657896e956b tempest-SnapshotMetadataTestJSON-468041301 None] Created volume successfully. Nov 04 19:08:14 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Deleted volume successfully. Nov 04 19:08:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-60eb74b8-40c8-4cbe-8837-fa3fee19ad8d tempest-VolumesGetTest-1947944500 None] Lock "cinder-635e4071-1280-44d6-a241-cbd9c3b2e073-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:15 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 1073741824" returned: 0 in 0.524s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 Nov 04 19:08:15 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:15 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845" returned: 0 in 0.310s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d637390-93a3-40c5-b9ea-3ab747880ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b51116-e75a-41da-af45-234962c9d845', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d80f8bd-71c5-4994-9b82-352bd0b86310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Volume volume-15b51116-e75a-41da-af45-234962c9d845 (15b51116-e75a-41da-af45-234962c9d845): created successfully Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d80f8bd-71c5-4994-9b82-352bd0b86310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (103aaf31-dc70-4d64-96c9-11e1b40ac9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f87d3947-2c07-48e1-9fd3-4b3f4ece8d0d tempest-GroupSnapshotsTest-1390717477 None] Created volume successfully. Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Creating offline snapshot eec58eb4-b57c-4017-b921-9456d83fd26d of volume cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97314af-a5b1-4773-a44a-1070a0d6267e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b Nov 04 19:08:15 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b" returned: 0 in 0.402s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:16 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d 1G Nov 04 19:08:16 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0922fd14-d4a0-42eb-b0de-37a080401787 tempest-GroupSnapshotsTest-1390717477 None] Update group completed successfully. Nov 04 19:08:16 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d 1G" returned: 0 in 0.571s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdc650ab-002f-479d-ba09-772ac40e8a0b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:16 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdc650ab-002f-479d-ba09-772ac40e8a0b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d Nov 04 19:08:16 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdc650ab-002f-479d-ba09-772ac40e8a0b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d" returned: 0 in 0.329s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d is being set with open permissions: ugo+rw Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d Nov 04 19:08:17 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info Nov 04 19:08:17 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info" returned: 0 in 0.300s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info is being set with open permissions: ugo+rw Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info Nov 04 19:08:17 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-22795a3b-45c6-420f-a191-3a1b2d33759a tempest-GroupSnapshotsTest-1390717477 None] Update group completed successfully. Nov 04 19:08:17 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.info" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9f2209e8-fee7-4759-9c6a-c80dc22d76eb tempest-SnapshotMetadataTestJSON-468041301 None] Create snapshot completed successfully Nov 04 19:08:19 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=167,cinder:DELETE=13,cinder:SELECT=139,cinder:INSERT=43 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a2578085-d324-4d55-9d3d-6ccb7c3db6a4 tempest-GroupSnapshotsTest-1390717477 None] Update group completed successfully. Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "cinder-eec58eb4-b57c-4017-b921-9456d83fd26d-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-eec58eb4-b57c-4017-b921-9456d83fd26d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "cinder-quobyte-eec58eb4-b57c-4017-b921-9456d83fd26d" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-eec58eb4-b57c-4017-b921-9456d83fd26d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Deleting offline snapshot eec58eb4-b57c-4017-b921-9456d83fd26d of volume cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] snapshot_file for this snap is: volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[07305e25-1466-46c7-8d5b-b8cc6573bdbf]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:20 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d Nov 04 19:08:20 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-499aff33-acc4-4b7a-b2f2-a2936568297a tempest-GroupSnapshotsTest-1390717477 None] Update group completed successfully. Nov 04 19:08:20 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d" returned: 0 in 0.491s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdc650ab-002f-479d-ba09-772ac40e8a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e9783-6a28-4eda-a845-40245d89e55d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:20 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b Nov 04 19:08:20 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:21 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b" returned: 0 in 0.432s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:21 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d Nov 04 19:08:21 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:21 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d" returned: 0 in 0.521s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:21 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d Nov 04 19:08:21 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b.eec58eb4-b57c-4017-b921-9456d83fd26d" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] GroupSnapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: creating. Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:22 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-eec58eb4-b57c-4017-b921-9456d83fd26d" released by "_delete_snapshot" :: held 2.093s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Group snapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: creating. {{(pid=87367) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" released by "delete_snapshot" :: held 2.145s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Creating offline snapshot 854c810d-d175-415f-9a55-ddf541956240 of volume 165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c23434-f52b-4cbd-8f18-c98b032e57a7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Created reservations ['489e0bae-dd78-4515-a471-989162db29ae', '3dde0f23-f54f-4f6e-9c34-3eff2744f729', 'bb2ecf49-5a7f-40ea-b24f-26422af9d8b1', '63112fca-3076-46c1-a6ef-e558d79ea0a4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Delete snapshot completed successfully. Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c99d4c73-c52a-4c71-84ff-4f888f5896ff tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-eec58eb4-b57c-4017-b921-9456d83fd26d-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:22 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.387s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:08:22 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 Nov 04 19:08:22 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:22 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96" returned: 0 in 0.535s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:22 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 1G Nov 04 19:08:22 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "cinder-cdc650ab-002f-479d-ba09-772ac40e8a0b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:23 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 1G" returned: 0 in 0.595s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165d5032-b607-45db-84bd-ecf7a8077a96 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-cdc650ab-002f-479d-ba09-772ac40e8a0b-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:23 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165d5032-b607-45db-84bd-ecf7a8077a96 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 Nov 04 19:08:23 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c385e13-7677-46c2-8739-a580848c6c9d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:23 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b Nov 04 19:08:23 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165d5032-b607-45db-84bd-ecf7a8077a96 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240" returned: 0 in 0.549s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 Nov 04 19:08:24 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b" returned: 0 in 0.789s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240" returned: 0 in 0.494s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b Nov 04 19:08:24 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info Nov 04 19:08:24 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdc650ab-002f-479d-ba09-772ac40e8a0b" returned: 0 in 0.338s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-quobyte-cdc650ab-002f-479d-ba09-772ac40e8a0b" released by "delete_volume" :: held 1.234s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:24 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info" returned: 0 in 0.334s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:24 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Created reservations ['70169b05-e646-4a82-8d55-b26511feb9b8', '81745627-d728-45c5-869e-a1fa2e2f835a', '328a70a5-9bea-4534-a796-7f9b4e4bbc70', '14c83438-2dac-410f-b6bf-8eb3a4c1c4a2'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:24 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info Nov 04 19:08:25 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:25 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.info" returned: 0 in 0.384s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.297s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Deleted volume successfully. Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Creating offline snapshot e4e6661b-679b-4445-9825-44d0e8b29b5d of volume 15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3536038-924c-41c8-bcaa-e6c80266a871 tempest-SnapshotMetadataTestJSON-468041301 None] Lock "cinder-cdc650ab-002f-479d-ba09-772ac40e8a0b-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[00277906-ee02-49fc-b829-4d0822058ab6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 Nov 04 19:08:25 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d 1G Nov 04 19:08:25 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:26 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d 1G" returned: 0 in 0.489s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15b51116-e75a-41da-af45-234962c9d845 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:26 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15b51116-e75a-41da-af45-234962c9d845 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d Nov 04 19:08:26 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:26 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15b51116-e75a-41da-af45-234962c9d845 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d" returned: 0 in 0.344s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:26 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:26 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d Nov 04 19:08:26 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:27 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info Nov 04 19:08:27 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info" returned: 0 in 0.312s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:27 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info Nov 04 19:08:27 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.info" returned: 0 in 0.309s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c00d8124-0717-4033-a894-d68d2915382e tempest-GroupSnapshotsTest-1390717477 None] group_snapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: created successfully Nov 04 19:08:28 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] group_snapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: deleting Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] group_snapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: deleting {{(pid=87367) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-854c810d-d175-415f-9a55-ddf541956240" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-854c810d-d175-415f-9a55-ddf541956240" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Deleting offline snapshot 854c810d-d175-415f-9a55-ddf541956240 of volume 165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] snapshot_file for this snap is: volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75d792-2301-4696-a1c2-2be73b8f880d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:29 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 Nov 04 19:08:29 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:29 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240" returned: 0 in 0.607s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165d5032-b607-45db-84bd-ecf7a8077a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:29 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b14b04-9869-4fc0-887b-84b80732ec77]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:29 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 Nov 04 19:08:29 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:30 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 Nov 04 19:08:30 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240" returned: 0 in 0.449s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:30 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240 Nov 04 19:08:30 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96.854c810d-d175-415f-9a55-ddf541956240" returned: 0 in 0.338s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-854c810d-d175-415f-9a55-ddf541956240" released by "_delete_snapshot" :: held 2.003s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" released by "delete_snapshot" :: held 2.035s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-e4e6661b-679b-4445-9825-44d0e8b29b5d" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-e4e6661b-679b-4445-9825-44d0e8b29b5d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Deleting offline snapshot e4e6661b-679b-4445-9825-44d0e8b29b5d of volume 15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] snapshot_file for this snap is: volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[005169c7-3902-463a-b52f-b311b5e94846]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d Nov 04 19:08:31 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:31 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d" returned: 0 in 0.636s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15b51116-e75a-41da-af45-234962c9d845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2f5e2-09aa-4c56-92b1-6974a3b082d6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 Nov 04 19:08:31 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Flow 'volume_create_manager' (cdc83d7e-ed1b-49f7-98eb-e7dd9fe7d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a818c9f-48ee-4067-a7da-03d28ea478c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a818c9f-48ee-4067-a7da-03d28ea478c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1356542336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10a2d8d-9d8b-43c2-b143-20483ad3d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d42d7205184b81ad5369bffa120810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:32Z,use_quota=True,user_id='b4ed9b73cc40427481af6363f43ae128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abe06ea-4de7-4469-91b3-48b188934fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abe06ea-4de7-4469-91b3-48b188934fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30a9d00-8435-4507-873e-a9d9ccef776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30a9d00-8435-4507-873e-a9d9ccef776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10a2d8d-9d8b-43c2-b143-20483ad3d40c', 'volume_name': 'volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e79cd0-7eba-4758-ba9b-812a5ef5da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e79cd0-7eba-4758-ba9b-812a5ef5da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f11c5-0d86-48db-892f-e15266fc38f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Volume f10a2d8d-9d8b-43c2-b143-20483ad3d40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c', 'volume_size': 1} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1356542336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10a2d8d-9d8b-43c2-b143-20483ad3d40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d42d7205184b81ad5369bffa120810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:32Z,use_quota=True,user_id='b4ed9b73cc40427481af6363f43ae128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Creating volume f10a2d8d-9d8b-43c2-b143-20483ad3d40c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:32 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c 1073741824 Nov 04 19:08:32 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845" returned: 0 in 0.461s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d Nov 04 19:08:32 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d" returned: 0 in 0.521s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c 1073741824" returned: 0 in 0.711s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d Nov 04 19:08:32 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:32 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c Nov 04 19:08:32 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:33 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845.e4e6661b-679b-4445-9825-44d0e8b29b5d" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:33 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" returned: 0 in 0.355s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-e4e6661b-679b-4445-9825-44d0e8b29b5d" released by "_delete_snapshot" :: held 2.228s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f11c5-0d86-48db-892f-e15266fc38f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c502c9-caa2-4bbd-9d2c-b578af004c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" released by "delete_snapshot" :: held 2.296s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:33 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Volume volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c (f10a2d8d-9d8b-43c2-b143-20483ad3d40c): created successfully Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c502c9-caa2-4bbd-9d2c-b578af004c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Flow 'volume_create_manager' (cdc83d7e-ed1b-49f7-98eb-e7dd9fe7d484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b95a7d8e-22fc-473d-be9b-98acb5dce606 tempest-VolumesTransfersV355Test-1161508764 None] Created volume successfully. Nov 04 19:08:33 devstack cinder-volume[87367]: WARNING cinder.quota [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1297567718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1297567718, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:33 devstack cinder-volume[87367]: WARNING cinder.quota [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1297567718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1297567718, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['c3b41790-2bd2-4dbe-98c4-6005b528171c', '11e1bc7b-11d0-4b03-b555-fac9e7c37938', 'ba55e451-f8ad-437f-824e-c25375bacea0', '6cd0a024-100a-448a-97e3-a34448720e4e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['91e9e189-4083-4fc3-a6eb-3d5ca02d48da', '7144b5de-8763-4c60-9838-13e62278f06f', '066d4dd1-35ef-4164-bd50-86ed0f5519d1', '3cf07b3a-99e4-483d-b7e7-bae508cccd18'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a8042a8e-acdc-4801-9985-a4b9365a4a9c tempest-GroupSnapshotsTest-1390717477 None] group_snapshot e76b0f34-1ad2-451e-b3a0-5d6ed8ee7001: deleted successfully Nov 04 19:08:35 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-10d94a64-0f8a-4781-bbce-5e79f8cb9ba8 tempest-VolumesTransfersV355Test-996401394 None] Transfer volume completed successfully. Nov 04 19:08:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" acquired by "delete_volume" :: waited 0.062s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d89d6ab-b8d7-40ff-a611-c11790ef436b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 Nov 04 19:08:35 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845" returned: 0 in 0.574s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845 Nov 04 19:08:36 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "cinder-f10a2d8d-9d8b-43c2-b143-20483ad3d40c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-f10a2d8d-9d8b-43c2-b143-20483ad3d40c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "cinder-quobyte-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-quobyte-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683b39b-1d05-43a3-abdf-f1a60959d3c9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c Nov 04 19:08:36 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-15b51116-e75a-41da-af45-234962c9d845" returned: 0 in 0.445s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-15b51116-e75a-41da-af45-234962c9d845" released by "delete_volume" :: held 1.122s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177303f-4d33-4bfb-a3db-3dce96107bde]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 Nov 04 19:08:36 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" returned: 0 in 0.579s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:37 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c Nov 04 19:08:37 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96" returned: 0 in 0.571s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:37 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96 Nov 04 19:08:37 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-quobyte-f10a2d8d-9d8b-43c2-b143-20483ad3d40c" released by "delete_volume" :: held 1.024s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Created reservations ['3a3c92de-7e09-491b-b052-10acaf3bf458', 'a6b315a4-f461-4cfd-8501-0a4279d2f0b5', 'b01b9297-1656-486d-8457-592abc8a079f', '5b520d40-e5b6-42fc-b870-3309e6ce11e1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:37 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:37 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-165d5032-b607-45db-84bd-ecf7a8077a96" returned: 0 in 0.484s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-165d5032-b607-45db-84bd-ecf7a8077a96" released by "delete_volume" :: held 1.173s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:37 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['e7a86cd2-a9c2-4f53-b642-307479cd3326'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:38 devstack cinder-volume[87367]: WARNING cinder.quota [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1297567718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1297567718, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['a3d50951-259b-4c25-bf51-5716156426e6', '53ab0d42-f635-45cf-a563-ef17143e720c', '7e3d9e92-b46b-4a7c-b877-96fd3113f481', '6f06c054-c9cb-42be-a71c-7b0c34f1a46d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:38 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.350s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Deleted volume successfully. Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-79eab650-755a-49a4-9632-33f1b0b82668 tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-f10a2d8d-9d8b-43c2-b143-20483ad3d40c-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['f1a8d491-ea8d-4f19-bc66-0f4bf66b1ac3', '563ec9c3-6e79-411f-9b1a-15dac6a8e348', '062308cc-eaf9-44b8-850e-62b9ab3612da', 'ae2f8d1c-bf51-4df4-bb25-cd627c186844'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:38 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:38 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:38 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.316s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:38 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-db8a7fc4-f29b-438f-bff7-ec123f13d136 tempest-GroupSnapshotsTest-1390717477 None] Delete group completed successfully. Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Flow 'volume_create_manager' (1021a733-4d2c-4bdf-b26c-af6ab5277ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e85dec-2ea4-48ad-9142-f51adcebf203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e85dec-2ea4-48ad-9142-f51adcebf203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1000851303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a233ab-cf99-487a-b632-73f05a245b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d42d7205184b81ad5369bffa120810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:39Z,use_quota=True,user_id='b4ed9b73cc40427481af6363f43ae128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeab0985-bcfe-4a0c-85e7-e5a4f1aa8efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeab0985-bcfe-4a0c-85e7-e5a4f1aa8efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de573c7-d00c-4c97-85f9-52aa6546c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de573c7-d00c-4c97-85f9-52aa6546c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a233ab-cf99-487a-b632-73f05a245b1e', 'volume_name': 'volume-b4a233ab-cf99-487a-b632-73f05a245b1e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69398c1-f0bb-4586-8491-f64efbe9499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69398c1-f0bb-4586-8491-f64efbe9499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e717d8cf-15e6-4fa3-9332-26fcb62b5078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Volume b4a233ab-cf99-487a-b632-73f05a245b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a233ab-cf99-487a-b632-73f05a245b1e', 'volume_size': 1} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1000851303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a233ab-cf99-487a-b632-73f05a245b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d42d7205184b81ad5369bffa120810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:39Z,use_quota=True,user_id='b4ed9b73cc40427481af6363f43ae128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Creating volume b4a233ab-cf99-487a-b632-73f05a245b1e {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:39 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:39 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e 1073741824 Nov 04 19:08:39 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Acquiring lock "cinder-bddded8c-0cff-4467-b827-f29a1d73b056-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "cinder-bddded8c-0cff-4467-b827-f29a1d73b056-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=176,cinder:SELECT=157,cinder:INSERT=58,cinder:DELETE=10 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Acquiring lock "cinder-quobyte-bddded8c-0cff-4467-b827-f29a1d73b056" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a20edf2b-c2d9-471d-ab6d-983e350dd97b tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-417096129: creating Nov 04 19:08:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "cinder-quobyte-bddded8c-0cff-4467-b827-f29a1d73b056" acquired by "delete_volume" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a20edf2b-c2d9-471d-ab6d-983e350dd97b tempest-GroupSnapshotsTest-1390717477 None] Group tempest-GroupSnapshotsTest-Group-417096129: created successfully Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbfb2b0-6d8e-4d12-87c6-a825f9e68ac1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:40 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e 1073741824" returned: 0 in 0.722s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a20edf2b-c2d9-471d-ab6d-983e350dd97b tempest-GroupSnapshotsTest-1390717477 None] Create group completed successfully. Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:40 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e Nov 04 19:08:40 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:40 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 Nov 04 19:08:40 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:40 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e" returned: 0 in 0.289s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e717d8cf-15e6-4fa3-9332-26fcb62b5078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a233ab-cf99-487a-b632-73f05a245b1e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b11e9a-8bb7-4cf8-91d6-b7c92f9fc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:40 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Volume volume-b4a233ab-cf99-487a-b632-73f05a245b1e (b4a233ab-cf99-487a-b632-73f05a245b1e): created successfully Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b11e9a-8bb7-4cf8-91d6-b7c92f9fc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Flow 'volume_create_manager' (1021a733-4d2c-4bdf-b26c-af6ab5277ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7b5fe99b-4ddf-4cea-85a1-551a076b6dc0 tempest-VolumesTransfersV355Test-1161508764 None] Created volume successfully. Nov 04 19:08:40 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:40 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056 Nov 04 19:08:40 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:40 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bddded8c-0cff-4467-b827-f29a1d73b056" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "cinder-quobyte-bddded8c-0cff-4467-b827-f29a1d73b056" released by "delete_volume" :: held 0.784s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Created reservations ['8f8b5e5f-a936-476e-84c9-667cc59177e3', '68119056-fafc-4b3f-9b6f-382c974ef3f6', '94b4edb0-34b0-4366-8380-53d81d41c61d', 'dc3fc872-c73b-4e36-8b95-cf72d8d2ff85'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:40 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:40 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:41 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.281s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Deleted volume successfully. Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d3285e-c0e8-453f-93f0-e915988ba666 tempest-AttachVolumeShelveTestJSON-1448560739 None] Lock "cinder-bddded8c-0cff-4467-b827-f29a1d73b056-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (c7e0dbae-4089-492e-add2-c82a78813773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72fe44e-d0b1-4837-9df4-d73529664640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "cinder-b4a233ab-cf99-487a-b632-73f05a245b1e-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72fe44e-d0b1-4837-9df4-d73529664640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528976903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa724fb5-cb20-40c8-9909-78a7b8b5d67a,host='devstack@QuobyteHD#QuobyteHD',id=d2b6ba13-0220-4236-b3d9-b9d0d47370d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:42Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052267c9-eca0-4082-805b-ba37c8a9baf9),volume_type_id=052267c9-eca0-4082-805b-ba37c8a9baf9)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a735c7-5311-4963-9213-8eb9b3654658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a735c7-5311-4963-9213-8eb9b3654658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef404f18-e50f-4d55-bb6f-ee0de3c34170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef404f18-e50f-4d55-bb6f-ee0de3c34170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b6ba13-0220-4236-b3d9-b9d0d47370d1', 'volume_name': 'volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec6ee98-930a-47a7-af85-16b4c02cd876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec6ee98-930a-47a7-af85-16b4c02cd876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bced4c-6703-43a6-8b56-7a183eba3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:41 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Volume d2b6ba13-0220-4236-b3d9-b9d0d47370d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1', 'volume_size': 1} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa724fb5-cb20-40c8-9909-78a7b8b5d67a,created_at=2026-11-04T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528976903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa724fb5-cb20-40c8-9909-78a7b8b5d67a,host='devstack@QuobyteHD#QuobyteHD',id=d2b6ba13-0220-4236-b3d9-b9d0d47370d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6e45b3104d4e25897cbf254d5d50ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:42Z,use_quota=True,user_id='3839dbd52d1f404d87ecb3b6392384d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(052267c9-eca0-4082-805b-ba37c8a9baf9),volume_type_id=052267c9-eca0-4082-805b-ba37c8a9baf9)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Creating volume d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:41 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-b4a233ab-cf99-487a-b632-73f05a245b1e-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:41 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 1073741824 Nov 04 19:08:41 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "cinder-quobyte-b4a233ab-cf99-487a-b632-73f05a245b1e" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-quobyte-b4a233ab-cf99-487a-b632-73f05a245b1e" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc961f-6976-4f3b-8ae4-8040cba95e87]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:42 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e Nov 04 19:08:42 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:42 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e" returned: 0 in 0.565s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:42 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e Nov 04 19:08:42 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:42 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 1073741824" returned: 0 in 0.774s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:42 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 Nov 04 19:08:42 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:43 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4a233ab-cf99-487a-b632-73f05a245b1e" returned: 0 in 0.448s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-quobyte-b4a233ab-cf99-487a-b632-73f05a245b1e" released by "delete_volume" :: held 1.094s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Created reservations ['4c51bff7-90e9-4dca-8e01-e3940285cf3e', '7e448b9d-910a-4832-8e34-1e4dc9529af6', '96194c02-ded9-47d0-9f05-7fa47d038758', '255ddda4-dec8-4580-912a-d41151b76edb'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:43 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" returned: 0 in 0.407s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bced4c-6703-43a6-8b56-7a183eba3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2428e-cae4-434b-b2c9-cb1a396e4c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:43 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Volume volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 (d2b6ba13-0220-4236-b3d9-b9d0d47370d1): created successfully Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c2428e-cae4-434b-b2c9-cb1a396e4c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Flow 'volume_create_manager' (c7e0dbae-4089-492e-add2-c82a78813773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-de2fe184-3d25-4a09-adcb-99db4f37d9dd tempest-GroupSnapshotsTest-1390717477 None] Created volume successfully. Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:43 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:43 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:43 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.268s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Deleted volume successfully. Nov 04 19:08:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-81fe3ff7-2f06-4623-910b-4a1773e1eb9b tempest-VolumesTransfersV355Test-1543068461 None] Lock "cinder-b4a233ab-cf99-487a-b632-73f05a245b1e-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] GroupSnapshot a0dd06ed-d785-46fc-a678-b141272d7a25: creating. Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Group snapshot a0dd06ed-d785-46fc-a678-b141272d7a25: creating. {{(pid=87367) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Creating offline snapshot 4e520c03-3677-467c-9aa0-b874ab87dae1 of volume d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d31312-4d4d-46ae-837f-c4d3c6c157d4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:44 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 Nov 04 19:08:44 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:45 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" returned: 0 in 0.682s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:45 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 1G Nov 04 19:08:45 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 1G" returned: 0 in 0.721s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 Nov 04 19:08:46 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 Nov 04 19:08:46 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:46 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1" returned: 0 in 0.310s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:46 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info Nov 04 19:08:46 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info" returned: 0 in 0.316s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:08:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:47 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info Nov 04 19:08:47 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:47 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.info" returned: 0 in 0.418s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-566b8b2e-3a0a-4655-8607-3d3c92e8b122 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot a0dd06ed-d785-46fc-a678-b141272d7a25: created successfully Nov 04 19:08:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot a0dd06ed-d785-46fc-a678-b141272d7a25: deleting Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot a0dd06ed-d785-46fc-a678-b141272d7a25: deleting {{(pid=87367) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-4e520c03-3677-467c-9aa0-b874ab87dae1" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-4e520c03-3677-467c-9aa0-b874ab87dae1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Deleting offline snapshot 4e520c03-3677-467c-9aa0-b874ab87dae1 of volume d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] snapshot_file for this snap is: volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a610f22-a57a-4b48-82f8-f6bae50c2da9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:48 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 Nov 04 19:08:48 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:48 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1" returned: 0 in 0.573s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4e5dc6-9090-4435-a717-28ee09dcf78a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 Nov 04 19:08:49 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:49 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" returned: 0 in 0.630s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:49 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 Nov 04 19:08:49 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:50 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1" returned: 0 in 0.525s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:50 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1 Nov 04 19:08:50 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:50 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1.4e520c03-3677-467c-9aa0-b874ab87dae1" returned: 0 in 0.340s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-4e520c03-3677-467c-9aa0-b874ab87dae1" released by "_delete_snapshot" :: held 2.287s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" released by "delete_snapshot" :: held 2.335s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:50 devstack cinder-volume[87367]: WARNING cinder.quota [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1148511458 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1148511458, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:50 devstack cinder-volume[87367]: WARNING cinder.quota [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1148511458 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1148511458, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:50 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['ac28b75c-fe20-45b8-b9fb-1db3b2d71587', '98cd0e82-8e83-4a98-b128-c86670b5c1bf', 'aa4ca471-3ea4-4486-af68-92e62cec6a07', 'eb66129c-2a7e-4e9c-bd6f-584dd4c2b6ea'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a9b172f5-7778-4840-9f47-17dfd866a991 tempest-GroupSnapshotsTest-1390717477 None] group_snapshot a0dd06ed-d785-46fc-a678-b141272d7a25: deleted successfully Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" acquired by "delete_volume" :: waited 0.039s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ce61e-4c4c-444d-827e-94f144cb95e5]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:52 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 Nov 04 19:08:52 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:52 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" returned: 0 in 0.473s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:52 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1 Nov 04 19:08:52 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:53 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" returned: 0 in 0.377s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Lock "cinder-quobyte-d2b6ba13-0220-4236-b3d9-b9d0d47370d1" released by "delete_volume" :: held 0.954s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['228f8e7c-a63f-45b7-8182-d1d9ef6d1ac1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:53 devstack cinder-volume[87367]: WARNING cinder.quota [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1148511458 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1148511458, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Created reservations ['6ae2ede9-be1b-4f35-9f64-069c402a1d28', 'f0288c96-bf92-4fd8-82fd-c1d923ad71b6', '2cd5bc0a-2b3f-4619-b204-41d9e6267d82', 'd53c551d-ec82-4595-b2a1-5fa3c4a0728b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:53 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:08:53 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (d8044a3c-cf3a-4401-8c4f-cf80e435915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc2c39d-c05c-41df-aa6c-7d04f9c35fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc2c39d-c05c-41df-aa6c-7d04f9c35fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566780189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7488ca92-48aa-4e23-a4bf-e27d9145040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:54Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69269dd7-3b71-4d95-b8d1-43a01e60e6a1),volume_type_id=69269dd7-3b71-4d95-b8d1-43a01e60e6a1)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a140-b6e8-4214-9b50-34d318196c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a140-b6e8-4214-9b50-34d318196c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4bc59c-3787-414f-b1b1-f6664a7cdf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4bc59c-3787-414f-b1b1-f6664a7cdf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7488ca92-48aa-4e23-a4bf-e27d9145040c', 'volume_name': 'volume-7488ca92-48aa-4e23-a4bf-e27d9145040c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a4e2c5-d3d3-4205-bbd8-c91d94fe869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a4e2c5-d3d3-4205-bbd8-c91d94fe869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c08f88-0a81-4056-b700-329da37d4e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume 7488ca92-48aa-4e23-a4bf-e27d9145040c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7488ca92-48aa-4e23-a4bf-e27d9145040c', 'volume_size': 1} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1566780189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7488ca92-48aa-4e23-a4bf-e27d9145040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:54Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69269dd7-3b71-4d95-b8d1-43a01e60e6a1),volume_type_id=69269dd7-3b71-4d95-b8d1-43a01e60e6a1)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Creating volume 7488ca92-48aa-4e23-a4bf-e27d9145040c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:54 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:54 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.381s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:54 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c 1073741824 Nov 04 19:08:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2833deb6-ed76-4589-8a79-d0f1bf0b73c5 tempest-GroupSnapshotsTest-1390717477 None] Delete group completed successfully. Nov 04 19:08:54 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (985218bb-6910-4575-8efd-489d1053998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e03eff-4e1b-4647-b833-488417888b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e03eff-4e1b-4647-b833-488417888b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-678199836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cce9a2-cb91-4c72-819d-0f3b48706ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:54Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ccf00e7-684b-4743-b33e-67c331e99b65),volume_type_id=6ccf00e7-684b-4743-b33e-67c331e99b65)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a58b0dd-54dd-4f52-aaa8-564b19fc1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a58b0dd-54dd-4f52-aaa8-564b19fc1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79231414-de63-407d-9d1b-7fc98ad081cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79231414-de63-407d-9d1b-7fc98ad081cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3cce9a2-cb91-4c72-819d-0f3b48706ea1', 'volume_name': 'volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6b3a55-c8d6-4c83-bed7-3f0eb7f8d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6b3a55-c8d6-4c83-bed7-3f0eb7f8d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b27f16-c7fb-4857-bd57-366cb0823726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume d3cce9a2-cb91-4c72-819d-0f3b48706ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1', 'volume_size': 1} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:54 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c 1073741824" returned: 0 in 0.727s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:54 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c Nov 04 19:08:54 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:55 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c" returned: 0 in 0.456s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-678199836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cce9a2-cb91-4c72-819d-0f3b48706ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:54Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ccf00e7-684b-4743-b33e-67c331e99b65),volume_type_id=6ccf00e7-684b-4743-b33e-67c331e99b65)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Creating volume d3cce9a2-cb91-4c72-819d-0f3b48706ea1 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:55 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c08f88-0a81-4056-b700-329da37d4e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7488ca92-48aa-4e23-a4bf-e27d9145040c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:55 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 1073741824 Nov 04 19:08:55 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a66870-a45a-433d-9568-00a01bbd1ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume volume-7488ca92-48aa-4e23-a4bf-e27d9145040c (7488ca92-48aa-4e23-a4bf-e27d9145040c): created successfully Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a66870-a45a-433d-9568-00a01bbd1ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (d8044a3c-cf3a-4401-8c4f-cf80e435915e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b314c8d1-2e00-4399-be4e-be0e9b81c7e0 tempest-TestInstancesWithCinderVolumes-1424705724 None] Created volume successfully. Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (215bf479-a867-42d5-a2a6-651b4058912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56a3b7-be84-4fd4-88ea-f2a2958975cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f56a3b7-be84-4fd4-88ea-f2a2958975cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063894776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c33bad-213f-453c-b7ac-d68972e46201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:55Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6f3d63e-86e6-42a7-9221-5b8e5c0d5152),volume_type_id=b6f3d63e-86e6-42a7-9221-5b8e5c0d5152)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e1d84e-823f-4886-b92e-168e5a159dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e1d84e-823f-4886-b92e-168e5a159dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f5360-898e-4aef-8e0f-d5605e524cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:55 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:08:56 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 1073741824" returned: 0 in 0.797s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:56 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 Nov 04 19:08:56 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f5360-898e-4aef-8e0f-d5605e524cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66c33bad-213f-453c-b7ac-d68972e46201', 'volume_name': 'volume-66c33bad-213f-453c-b7ac-d68972e46201', 'volume_size': 1, 'image_id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1744879665', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a7a186a305a4038a807e61ee3a61ce4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'created_at': datetime.datetime(2026, 11, 4, 18, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 8, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/877f7325-b241-42d0-b161-3c95d0096ebf/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be58ca-89b6-4d17-9659-f308d036c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be58ca-89b6-4d17-9659-f308d036c51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f431f8-49b8-4fee-abab-ca07720ed4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume 66c33bad-213f-453c-b7ac-d68972e46201: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66c33bad-213f-453c-b7ac-d68972e46201', 'volume_size': 1, 'image_id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1744879665', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a7a186a305a4038a807e61ee3a61ce4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'created_at': datetime.datetime(2026, 11, 4, 18, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 8, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/877f7325-b241-42d0-b161-3c95d0096ebf/file', 'properties': {}}, 'image_service': } Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Trying to clone 66c33bad-213f-453c-b7ac-d68972e46201 from image 877f7325-b241-42d0-b161-3c95d0096ebf at location (None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Flow 'volume_create_manager' (42906b46-75a5-4930-8a63-e9ea46c9c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac6b8d7-148e-4364-99e4-08a004b370f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac6b8d7-148e-4364-99e4-08a004b370f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-887249081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376fc031-fbaf-4741-b7fe-c174b4b844b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91add67b8d7f46bc88a496110ee4e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:56Z,use_quota=True,user_id='2ecf6886dd4d4f859651590f1ccf6801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d36dfab-b267-4227-a922-60259d83d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d36dfab-b267-4227-a922-60259d83d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b88c01-1d64-4495-8795-f85f58d3b105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b88c01-1d64-4495-8795-f85f58d3b105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376fc031-fbaf-4741-b7fe-c174b4b844b6', 'volume_name': 'volume-376fc031-fbaf-4741-b7fe-c174b4b844b6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e0a8c9-0020-4b32-b92c-838fd6b65f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e0a8c9-0020-4b32-b92c-838fd6b65f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f53c6a-4593-4e12-aa18-35f9acb91b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Volume 376fc031-fbaf-4741-b7fe-c174b4b844b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376fc031-fbaf-4741-b7fe-c174b4b844b6', 'volume_size': 1} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" returned: 0 in 0.473s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-887249081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376fc031-fbaf-4741-b7fe-c174b4b844b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91add67b8d7f46bc88a496110ee4e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:56Z,use_quota=True,user_id='2ecf6886dd4d4f859651590f1ccf6801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Creating volume 376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:56 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:56 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 1073741824 Nov 04 19:08:56 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b27f16-c7fb-4857-bd57-366cb0823726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65c81a6-90e3-4e2d-80c0-a1c851fe32be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 (d3cce9a2-cb91-4c72-819d-0f3b48706ea1): created successfully Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65c81a6-90e3-4e2d-80c0-a1c851fe32be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (985218bb-6910-4575-8efd-489d1053998c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2f589dd7-bc0a-4047-863d-cb8edea488df tempest-TestInstancesWithCinderVolumes-1424705724 None] Created volume successfully. Nov 04 19:08:57 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 1073741824" returned: 0 in 0.591s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:57 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:08:57 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:57 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.447s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f53c6a-4593-4e12-aa18-35f9acb91b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376fc031-fbaf-4741-b7fe-c174b4b844b6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef0667e-eb8d-4ae8-82d7-21fefaeba644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Volume volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 (376fc031-fbaf-4741-b7fe-c174b4b844b6): created successfully Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef0667e-eb8d-4ae8-82d7-21fefaeba644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Flow 'volume_create_manager' (42906b46-75a5-4930-8a63-e9ea46c9c90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-948aeb5d-24ac-43d0-808a-c7288a37517a tempest-VolumesCloneTest-772542563 None] Created volume successfully. Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Flow 'volume_create_manager' (88c20ea8-dcb5-43ce-8455-93f8420ba102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d970d9d-3089-469f-8dbe-f69ae3eb11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d970d9d-3089-469f-8dbe-f69ae3eb11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-305559785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5156bd5-bf59-4404-a524-576a3ef03ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91add67b8d7f46bc88a496110ee4e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=376fc031-fbaf-4741-b7fe-c174b4b844b6,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:59Z,use_quota=True,user_id='2ecf6886dd4d4f859651590f1ccf6801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21d7a0a-0347-4ddb-83d5-e54a5d5dd61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21d7a0a-0347-4ddb-83d5-e54a5d5dd61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231e5cb3-7892-422d-82e4-babb4c65dd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231e5cb3-7892-422d-82e4-babb4c65dd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c5156bd5-bf59-4404-a524-576a3ef03ef7', 'volume_name': 'volume-c5156bd5-bf59-4404-a524-576a3ef03ef7', 'volume_size': 2, 'source_volid': '376fc031-fbaf-4741-b7fe-c174b4b844b6', 'source_volstatus': 'available'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50b0d4-88ac-4fdd-96cc-b67089c28679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50b0d4-88ac-4fdd-96cc-b67089c28679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af7e66f-e260-467d-b05d-caf0f4b1b3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Volume c5156bd5-bf59-4404-a524-576a3ef03ef7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c5156bd5-bf59-4404-a524-576a3ef03ef7', 'volume_size': 2, 'source_volid': '376fc031-fbaf-4741-b7fe-c174b4b844b6', 'source_volstatus': 'available'} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:59 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Cloning volume 376fc031-fbaf-4741-b7fe-c174b4b844b6 to volume c5156bd5-bf59-4404-a524-576a3ef03ef7 Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Creating offline snapshot 942e4e00-dba4-4f42-b59a-41d3afc3630a of volume 376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c30fd-f581-4082-9526-7aee3f15f8c3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:59 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:08:59 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.504s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a 1G Nov 04 19:09:00 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a 1G" returned: 0 in 0.770s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:00 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD, size 20.69 MB, duration 4.64 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:09:01 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Image download 20.69 MB at 4.45 MB/s Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd1d971-064c-4ed7-b8c0-d62bae62c35c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.348s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a is being set with open permissions: ugo+rw Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:01 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD Nov 04 19:09:01 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Temporary image 877f7325-b241-42d0-b161-3c95d0096ebf is fetched for user 881e1d698c474fe5b70519916bc201bc. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:09:01 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info Nov 04 19:09:01 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5abe644-2d02-4c98-831a-665c4be362ba]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info" returned: 0 in 0.309s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info is being set with open permissions: ugo+rw Nov 04 19:09:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD Nov 04 19:09:01 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info Nov 04 19:09:01 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.info" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] snapshot: 942e4e00-dba4-4f42-b59a-41d3afc3630a, volume: c5156bd5-bf59-4404-a524-576a3ef03ef7, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:09:02 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[107aed7d-0d70-49aa-917d-62b00dc2fcae]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:02 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.448s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376fc031-fbaf-4741-b7fe-c174b4b844b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28c138a-c862-47e1-938a-91b74547c2b9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:09:02 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:03 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.471s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:09:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:09:03 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:09:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:03 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 Nov 04 19:09:03 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=106,cinder:UPDATE=104,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=56,cinder:SELECT=44,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:11 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7" returned: 0 in 8.669s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:11 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:09:11 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Converted 1024.00 MB image at 118.10 MB/s Nov 04 19:09:11 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 is being set with open permissions: ugo+rw Nov 04 19:09:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 Nov 04 19:09:11 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7" returned: 0 in 0.309s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" released by "_copy_volume_from_snapshot" :: held 10.000s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-quobyte-942e4e00-dba4-4f42-b59a-41d3afc3630a" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-942e4e00-dba4-4f42-b59a-41d3afc3630a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Deleting offline snapshot 942e4e00-dba4-4f42-b59a-41d3afc3630a of volume 376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] snapshot_file for this snap is: volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8181609-f65a-4729-aa7a-b2e6ea9c1f9d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:12 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.457s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376fc031-fbaf-4741-b7fe-c174b4b844b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eece22-3dea-412c-ba0e-fbd486fb9306]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:09:12 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.572s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:13 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.465s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a Nov 04 19:09:13 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:14 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6.942e4e00-dba4-4f42-b59a-41d3afc3630a" returned: 0 in 0.257s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-942e4e00-dba4-4f42-b59a-41d3afc3630a" released by "_delete_snapshot" :: held 1.868s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.692s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.910s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2063894776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c33bad-213f-453c-b7ac-d68972e46201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7a186a305a4038a807e61ee3a61ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:55Z,use_quota=True,user_id='881e1d698c474fe5b70519916bc201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6f3d63e-86e6-42a7-9221-5b8e5c0d5152),volume_type_id=b6f3d63e-86e6-42a7-9221-5b8e5c0d5152)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Creating volume 66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:14 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af7e66f-e260-467d-b05d-caf0f4b1b3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5156bd5-bf59-4404-a524-576a3ef03ef7', 'volume_size': 2, 'source_volid': '376fc031-fbaf-4741-b7fe-c174b4b844b6', 'source_volstatus': 'available'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:14 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1073741824 Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c2302-e176-44ac-9e62-ace91b73735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:14 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Volume volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 (c5156bd5-bf59-4404-a524-576a3ef03ef7): created successfully Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c2302-e176-44ac-9e62-ace91b73735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Flow 'volume_create_manager' (88c20ea8-dcb5-43ce-8455-93f8420ba102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1678ba05-840e-4468-8546-1b19da97a526 tempest-VolumesCloneTest-772542563 None] Created volume successfully. Nov 04 19:09:14 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1073741824" returned: 0 in 0.582s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:14 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 Nov 04 19:09:14 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201" returned: 0 in 0.329s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Attempting download of 877f7325-b241-42d0-b161-3c95d0096ebf ((None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}])) to volume 66c33bad-213f-453c-b7ac-d68972e46201. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-c5156bd5-bf59-4404-a524-576a3ef03ef7-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[78130f9e-2ea8-42f2-8dc1-af6ad72bf791]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "cinder-c5156bd5-bf59-4404-a524-576a3ef03ef7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:15 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ffb64-3e89-4334-aafa-c4d78d7ac586]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:15 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 Nov 04 19:09:15 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s" returned: 0 in 0.497s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s Nov 04 19:09:15 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7" returned: 0 in 0.498s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7 Nov 04 19:09:15 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s" returned: 1 in 0.404s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_877f7325-b241-42d0-b161-3c95d0096ebf_nsg6fn1s' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4370daca-749b-4202-a7c0-eb4ea11e6e73]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c5156bd5-bf59-4404-a524-576a3ef03ef7" returned: 0 in 0.375s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-c5156bd5-bf59-4404-a524-576a3ef03ef7" released by "delete_volume" :: held 0.959s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:16 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD Nov 04 19:09:16 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Created reservations ['e36b1334-64d4-42e0-86b3-fe318253ea34', 'e3824d34-3693-48c3-89c9-dc0a16f9b031', 'cc37c7c5-c359-448a-af1d-fa6ac3ff21f0', '63a0b6b2-64e7-449c-93b0-1caf8fc2d92f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:09:16 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] 877f7325-b241-42d0-b161-3c95d0096ebf was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 Nov 04 19:09:16 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.389s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Deleted volume successfully. Nov 04 19:09:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1040abc6-40b1-45dd-ac03-5c1332decdf8 tempest-VolumesCloneTest-772542563 None] Lock "cinder-c5156bd5-bf59-4404-a524-576a3ef03ef7-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-376fc031-fbaf-4741-b7fe-c174b4b844b6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "cinder-376fc031-fbaf-4741-b7fe-c174b4b844b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Acquiring lock "cinder-quobyte-376fc031-fbaf-4741-b7fe-c174b4b844b6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-376fc031-fbaf-4741-b7fe-c174b4b844b6" acquired by "delete_volume" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef54b662-f0b2-4f84-844e-a7cf14e2aacc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:09:18 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.553s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:18 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6 Nov 04 19:09:18 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:18 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-376fc031-fbaf-4741-b7fe-c174b4b844b6" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "cinder-quobyte-376fc031-fbaf-4741-b7fe-c174b4b844b6" released by "delete_volume" :: held 1.049s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Created reservations ['c3585835-1bb8-44ad-8b02-5cb4729ed850', '2e928694-d046-42b5-9b56-1ae8fb3bc412', '6a549481-7f72-4567-a0c5-1043200049f5', 'fe2da305-0cf0-444a-a015-7fd66344bfb3'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:19 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:09:19 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:19 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.388s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Deleted volume successfully. Nov 04 19:09:19 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201" returned: 0 in 2.855s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_877f7325-b241-42d0-b161-3c95d0096ebf_7epqc495devstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:09:19 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Converted 112.00 MB image at 39.21 MB/s Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d1aaac13-596f-4b1a-833d-0b0bef18dc9d tempest-VolumesCloneTest-772542563 None] Lock "cinder-376fc031-fbaf-4741-b7fe-c174b4b844b6-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:19 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1G Nov 04 19:09:19 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:20 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 1G" returned: 0 in 0.584s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Downloaded image 877f7325-b241-42d0-b161-3c95d0096ebf ((None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}])) to volume 66c33bad-213f-453c-b7ac-d68972e46201 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Temporary image 877f7325-b241-42d0-b161-3c95d0096ebf for user 881e1d698c474fe5b70519916bc201bc is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Marking volume 66c33bad-213f-453c-b7ac-d68972e46201 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Copying metadata from image 877f7325-b241-42d0-b161-3c95d0096ebf to 66c33bad-213f-453c-b7ac-d68972e46201. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Creating volume glance metadata for volume 66c33bad-213f-453c-b7ac-d68972e46201 backed by image 877f7325-b241-42d0-b161-3c95d0096ebf with: {'image_id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'image_name': 'tempest-scenario-img--1744879665', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f431f8-49b8-4fee-abab-ca07720ed4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c33bad-213f-453c-b7ac-d68972e46201', 'volume_size': 1, 'image_id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/877f7325-b241-42d0-b161-3c95d0096ebf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1744879665', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a7a186a305a4038a807e61ee3a61ce4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '877f7325-b241-42d0-b161-3c95d0096ebf', 'created_at': datetime.datetime(2026, 11, 4, 18, 8, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 8, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/877f7325-b241-42d0-b161-3c95d0096ebf/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837b83e2-988e-4356-b067-2755e62cc51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Volume volume-66c33bad-213f-453c-b7ac-d68972e46201 (66c33bad-213f-453c-b7ac-d68972e46201): created successfully Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837b83e2-988e-4356-b067-2755e62cc51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Flow 'volume_create_manager' (215bf479-a867-42d5-a2a6-651b4058912f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9e635595-76a5-4d62-8583-640cf8bbcf08 tempest-TestInstancesWithCinderVolumes-1424705724 None] Created volume successfully. Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:22 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:09:22 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:22 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.603s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:09:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:09:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6242d37d-7150-4f81-9021-7379a2802635 tempest-GroupsV320Test-1259973166 None] Group tempest-GroupsV320Test-Group-1188095593: creating Nov 04 19:09:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6242d37d-7150-4f81-9021-7379a2802635 tempest-GroupsV320Test-1259973166 None] Group tempest-GroupsV320Test-Group-1188095593: created successfully Nov 04 19:09:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6242d37d-7150-4f81-9021-7379a2802635 tempest-GroupsV320Test-1259973166 None] Create group completed successfully. Nov 04 19:09:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-cb8d2789-54ab-4c53-95cb-11aaf0776965 req-873aa830-c722-47b5-a2bd-ee25ff75a271 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-cb8d2789-54ab-4c53-95cb-11aaf0776965 req-873aa830-c722-47b5-a2bd-ee25ff75a271 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-cb8d2789-54ab-4c53-95cb-11aaf0776965 req-873aa830-c722-47b5-a2bd-ee25ff75a271 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-cb8d2789-54ab-4c53-95cb-11aaf0776965 req-873aa830-c722-47b5-a2bd-ee25ff75a271 tempest-TestInstancesWithCinderVolumes-1424705724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-66c33bad-213f-453c-b7ac-d68972e46201', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5cfaaa3-cdfe-41ad-aeda-d9d0ecf65341', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:09:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-cb8d2789-54ab-4c53-95cb-11aaf0776965 req-873aa830-c722-47b5-a2bd-ee25ff75a271 tempest-TestInstancesWithCinderVolumes-1424705724 None] attachment_update completed successfully. Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Created reservations ['afd3c85d-05e7-46d8-af67-8e5a48017723'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:27 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:09:27 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:27 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.591s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-99a0530e-d1b7-415a-8f9f-ea3273a7b907 tempest-GroupsV320Test-1259973166 None] Delete group completed successfully. Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Flow 'volume_create_manager' (02baecd0-5d52-43e2-ad85-88746bd583b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd628b7a-5549-41af-9019-598d5ef7a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd628b7a-5549-41af-9019-598d5ef7a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1284520221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3d7e2b-47a4-4538-890e-b2de41356572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac461b7e402a4b8181091e83bd160712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:29Z,use_quota=True,user_id='a9a06bc4751a464a87aa361941177e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f227641-3803-466e-b3bd-fab66456b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f227641-3803-466e-b3bd-fab66456b23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b70bdac-40a8-415f-af63-767e98820fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b70bdac-40a8-415f-af63-767e98820fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3d7e2b-47a4-4538-890e-b2de41356572', 'volume_name': 'volume-6f3d7e2b-47a4-4538-890e-b2de41356572', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539308e0-9baa-49b8-9699-c2e269cd20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539308e0-9baa-49b8-9699-c2e269cd20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d7ff05-4bac-499a-81ab-49c38d81b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Volume 6f3d7e2b-47a4-4538-890e-b2de41356572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3d7e2b-47a4-4538-890e-b2de41356572', 'volume_size': 1} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1284520221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3d7e2b-47a4-4538-890e-b2de41356572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac461b7e402a4b8181091e83bd160712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:29Z,use_quota=True,user_id='a9a06bc4751a464a87aa361941177e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Creating volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:29 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:29 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 1073741824 Nov 04 19:09:29 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:29 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 1073741824" returned: 0 in 0.623s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:29 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 Nov 04 19:09:29 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:30 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572" returned: 0 in 0.411s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d7ff05-4bac-499a-81ab-49c38d81b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3d7e2b-47a4-4538-890e-b2de41356572', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff575a-13b8-437c-96e1-a03784813119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Volume volume-6f3d7e2b-47a4-4538-890e-b2de41356572 (6f3d7e2b-47a4-4538-890e-b2de41356572): created successfully Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff575a-13b8-437c-96e1-a03784813119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Flow 'volume_create_manager' (02baecd0-5d52-43e2-ad85-88746bd583b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-afc0443a-5351-4e8f-a40f-14094bac953d tempest-VolumesSnapshotListTestJSON-1064522325 None] Created volume successfully. Nov 04 19:09:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Creating offline snapshot 074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc7f52-ca65-4f27-8ee8-8f559d7540de]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:31 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 Nov 04 19:09:31 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:32 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572" returned: 0 in 0.744s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:32 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 1G Nov 04 19:09:32 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:33 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 1G" returned: 0 in 0.925s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:33 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:33 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:33 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.623s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:33 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 is being set with open permissions: ugo+rw Nov 04 19:09:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:33 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:33 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:34 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.315s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:34 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info Nov 04 19:09:34 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:34 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info" returned: 0 in 0.617s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:34 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info is being set with open permissions: ugo+rw Nov 04 19:09:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:34 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info Nov 04 19:09:34 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:35 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.info" returned: 0 in 0.525s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.952s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:35 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-98e12f06-dc1a-49c9-949d-db86ea5330e6 tempest-VolumesSnapshotListTestJSON-1064522325 None] Create snapshot completed successfully Nov 04 19:09:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Creating offline snapshot 208625b8-70b5-42e6-85cd-db6c389b8ff6 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da3f8b-8fd0-4d3c-b4f3-f369055c39b1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:36 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:36 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:37 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.758s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:37 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 1G Nov 04 19:09:37 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:37 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 1G" returned: 0 in 0.656s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:37 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:37 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:38 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.455s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:38 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 is being set with open permissions: ugo+rw Nov 04 19:09:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:38 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:38 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:38 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.409s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e5481338-ab05-4cb3-86d8-fdef073afe68 tempest-VolumesSnapshotListTestJSON-1064522325 None] Create snapshot completed successfully Nov 04 19:09:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Creating offline snapshot f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:39 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aecf44-ca87-4296-a7c7-d0b8698d4544]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:40 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:40 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:40 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.731s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:40 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 1G Nov 04 19:09:40 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:41 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 1G" returned: 0 in 0.862s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:41 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 Nov 04 19:09:41 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:42 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" returned: 0 in 0.520s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:42 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 is being set with open permissions: ugo+rw Nov 04 19:09:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:42 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 Nov 04 19:09:42 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:42 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" returned: 0 in 0.435s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:42 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7de5a547-9f07-471c-9e2a-532018d7474b tempest-VolumesSnapshotListTestJSON-1064522325 None] Create snapshot completed successfully Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Deleting offline snapshot f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] snapshot_file for this snap is: volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58ee19f-54f7-4436-bc6b-f4e3bf51eccf]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:45 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 Nov 04 19:09:45 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:45 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" returned: 0 in 0.586s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6942e6-afdc-4161-8270-d094de46f1e4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:46 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:46 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:46 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.668s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:46 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 Nov 04 19:09:46 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:47 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" returned: 0 in 0.703s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:47 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5 Nov 04 19:09:47 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:47 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" returned: 0 in 0.410s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5" released by "_delete_snapshot" :: held 2.637s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" released by "delete_snapshot" :: held 2.692s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:47 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Created reservations ['c34181bf-9e2b-4d2f-b580-4d9106648827', '52763ff6-8f1d-429a-bfa1-f3ec68e2c06f', 'd43117a4-5f7e-48dc-a228-dbb8ca889d02', 'db5b80b7-8fe2-4017-a977-29c25dbb6b9b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Delete snapshot completed successfully. Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7eb78562-903e-47ce-adb8-f0a8c3fb9ad0 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-f75ec8a2-8ef3-46d6-86b7-1be0e67e4ff5-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-208625b8-70b5-42e6-85cd-db6c389b8ff6-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-208625b8-70b5-42e6-85cd-db6c389b8ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-208625b8-70b5-42e6-85cd-db6c389b8ff6" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-208625b8-70b5-42e6-85cd-db6c389b8ff6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Deleting offline snapshot 208625b8-70b5-42e6-85cd-db6c389b8ff6 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] snapshot_file for this snap is: volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e20c46-b7ad-450b-b2f4-c474a0dbb332]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (469b68b0-9882-48b2-881b-15b027e9a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256831e-6c7a-44aa-a886-89a6743d0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d256831e-6c7a-44aa-a886-89a6743d0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2069939142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:49Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baca077-f994-4ac3-85b8-c9a5f9a246bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baca077-f994-4ac3-85b8-c9a5f9a246bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f66236-b5ab-4303-91ff-528d1b41a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f66236-b5ab-4303-91ff-528d1b41a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f', 'volume_name': 'volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7e58c-9d0a-4b49-ab48-db617702e10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e7e58c-9d0a-4b49-ab48-db617702e10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bd984f-722f-4ceb-b84e-7f1138724f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:48 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Volume 6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f', 'volume_size': 1} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2069939142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:49Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Creating volume 6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:48 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:09:48 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:48 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:48 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f 1073741824 Nov 04 19:09:48 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:49 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.454s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[21968ef9-b22c-4101-a491-b997fdded9c1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:49 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:49 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:49 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f 1073741824" returned: 0 in 0.548s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:49 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f Nov 04 19:09:49 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:49 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.534s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:49 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:49 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:49 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" returned: 0 in 0.349s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bd984f-722f-4ceb-b84e-7f1138724f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b7c91-4114-4435-ade2-91718c310f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:49 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Volume volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f (6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f): created successfully Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b7c91-4114-4435-ade2-91718c310f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (469b68b0-9882-48b2-881b-15b027e9a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-40155737-aa40-4dfd-957c-1ca08685a4fe tempest-AttachVolumeTestJSON-1877871074 None] Created volume successfully. Nov 04 19:09:50 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.530s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:50 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6 Nov 04 19:09:50 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:50 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.208625b8-70b5-42e6-85cd-db6c389b8ff6" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-208625b8-70b5-42e6-85cd-db6c389b8ff6" released by "_delete_snapshot" :: held 1.971s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" released by "delete_snapshot" :: held 2.020s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Created reservations ['5bb8e2f4-7360-4e9e-91fa-fe2cdf4a56cc', '6f65dfcf-2055-49f1-bc7c-88f21ee3fa6a', '7fe3d6d7-650a-46b9-8869-37ae97e5f8c5', '2d48c249-6525-488e-9956-f6c07708bd29'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Delete snapshot completed successfully. Nov 04 19:09:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a589367a-4111-4187-9574-525a7c7215a1 tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-208625b8-70b5-42e6-85cd-db6c389b8ff6-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Deleting offline snapshot 074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 of volume 6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] snapshot_file for this snap is: volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e37735-99a3-4ecd-8dba-11bcbce2b2f9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-039f4447-d3bc-4722-bd05-22c72b26526a req-21874bd0-d3f0-42a9-876b-aef855c98ec0 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-039f4447-d3bc-4722-bd05-22c72b26526a req-21874bd0-d3f0-42a9-876b-aef855c98ec0 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-039f4447-d3bc-4722-bd05-22c72b26526a req-21874bd0-d3f0-42a9-876b-aef855c98ec0 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-039f4447-d3bc-4722-bd05-22c72b26526a req-21874bd0-d3f0-42a9-876b-aef855c98ec0 tempest-AttachVolumeTestJSON-1877871074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe979023-0927-449c-83ef-1fbac04bdbc6', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:09:52 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:52 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-039f4447-d3bc-4722-bd05-22c72b26526a req-21874bd0-d3f0-42a9-876b-aef855c98ec0 tempest-AttachVolumeTestJSON-1877871074 None] attachment_update completed successfully. Nov 04 19:09:52 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.490s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3d7e2b-47a4-4538-890e-b2de41356572(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:52 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ded192-e6bf-4292-902d-74269ac9b381]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:52 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 Nov 04 19:09:52 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:53 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572" returned: 0 in 0.547s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:53 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:53 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:53 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.398s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:53 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52 Nov 04 19:09:53 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:53 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572.074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52" released by "_delete_snapshot" :: held 1.940s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" released by "delete_snapshot" :: held 1.987s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:53 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Created reservations ['de6c031a-a19b-4168-b2cf-bbc92f18015e', 'd431cab1-6e8e-4289-96b7-eb41ea85947e', '8fb4cc32-4775-4f32-8ce9-1a9f0815c0e8', 'd0c3d9e8-875a-47e0-a537-74315252298e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Delete snapshot completed successfully. Nov 04 19:09:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4a5af82-fd24-4c75-b76b-c992baf1307a tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-074f3fbf-ce5d-4d62-93d8-a3ee728ffb52-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-6f3d7e2b-47a4-4538-890e-b2de41356572-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-6f3d7e2b-47a4-4538-890e-b2de41356572-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9a1d1-6262-49d8-ad1f-c939afdd5e36]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:55 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 Nov 04 19:09:55 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:55 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:55 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572 Nov 04 19:09:55 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:55 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6f3d7e2b-47a4-4538-890e-b2de41356572" returned: 0 in 0.274s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-quobyte-6f3d7e2b-47a4-4538-890e-b2de41356572" released by "delete_volume" :: held 0.781s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Created reservations ['ec5c24e3-4572-4f54-9aeb-6e4ea0a65586', '3fca49d4-7cb9-4d83-a26c-04d47b59fcf5', '0d12d163-5b49-42dc-a42c-c8cbba967aa7', '71d65f23-f067-46ea-a02e-43d5a1f9ed17'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:56 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:09:56 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:56 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.326s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Deleted volume successfully. Nov 04 19:09:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-857e1f63-5912-412a-b998-e884e31a8dbe tempest-VolumesSnapshotListTestJSON-1064522325 None] Lock "cinder-6f3d7e2b-47a4-4538-890e-b2de41356572-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Flow 'volume_create_manager' (52d7d2ea-3d7b-43cc-807b-d7f9e3c0abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a31487c-4640-4729-996c-c10ef01a40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a31487c-4640-4729-996c-c10ef01a40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-499821538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d94786c-6490-426d-a113-dac289038e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3788a9a23e4d2a9005b29615eb0f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:59Z,use_quota=True,user_id='0fdec115734342f98ea3f2d82258f772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca947fa-66a7-4ab6-bdc6-255a7c3d4f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca947fa-66a7-4ab6-bdc6-255a7c3d4f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c86aa9-8158-4a85-a62b-f831355c3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c86aa9-8158-4a85-a62b-f831355c3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d94786c-6490-426d-a113-dac289038e0c', 'volume_name': 'volume-4d94786c-6490-426d-a113-dac289038e0c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80542764-412f-4a60-b675-ed43db6715d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80542764-412f-4a60-b675-ed43db6715d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbda9ec4-a388-44f9-8af4-1e3004a63603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Volume 4d94786c-6490-426d-a113-dac289038e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d94786c-6490-426d-a113-dac289038e0c', 'volume_size': 1} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-499821538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d94786c-6490-426d-a113-dac289038e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3788a9a23e4d2a9005b29615eb0f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:59Z,use_quota=True,user_id='0fdec115734342f98ea3f2d82258f772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Creating volume 4d94786c-6490-426d-a113-dac289038e0c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:59 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:09:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:59 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c 1073741824 Nov 04 19:09:59 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:00 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c 1073741824" returned: 0 in 0.972s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:00 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c Nov 04 19:10:00 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:01 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c" returned: 0 in 0.400s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbda9ec4-a388-44f9-8af4-1e3004a63603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d94786c-6490-426d-a113-dac289038e0c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce7dbf3-6790-4fa4-b6b7-0c6f8259ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Volume volume-4d94786c-6490-426d-a113-dac289038e0c (4d94786c-6490-426d-a113-dac289038e0c): created successfully Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce7dbf3-6790-4fa4-b6b7-0c6f8259ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Flow 'volume_create_manager' (52d7d2ea-3d7b-43cc-807b-d7f9e3c0abde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2cdb3534-33d4-4a43-bd16-cdf58ce5654b tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Created volume successfully. Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Acquiring lock "cinder-4d94786c-6490-426d-a113-dac289038e0c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "cinder-4d94786c-6490-426d-a113-dac289038e0c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Acquiring lock "cinder-quobyte-4d94786c-6490-426d-a113-dac289038e0c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "cinder-quobyte-4d94786c-6490-426d-a113-dac289038e0c" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d7c02-e801-430f-b0a1-b5ba276a430d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:03 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c Nov 04 19:10:03 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:04 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c" returned: 0 in 0.449s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:04 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c Nov 04 19:10:04 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:04 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d94786c-6490-426d-a113-dac289038e0c" returned: 0 in 0.269s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "cinder-quobyte-4d94786c-6490-426d-a113-dac289038e0c" released by "delete_volume" :: held 0.777s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Created reservations ['7a03b500-ee91-4e63-bb96-71a1f22a017a', '903dd662-9894-4472-9591-10eee50f4f55', '4ed7ffde-add5-4167-84b4-7449553f0101', '8d963e50-9dce-4870-8e2b-b83aace9c651'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:04 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:04 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:05 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:05 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Deleted volume successfully. Nov 04 19:10:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1e830ba4-4d24-44c0-b421-f8840585da59 tempest-VolumeQuotasNegativeTestJSON-1414249326 None] Lock "cinder-4d94786c-6490-426d-a113-dac289038e0c-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ad27380e-6bd5-432d-a91d-df017df61108 req-56c3688c-f331-4a88-9e57-01ded702c8b4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ad27380e-6bd5-432d-a91d-df017df61108 req-56c3688c-f331-4a88-9e57-01ded702c8b4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ad27380e-6bd5-432d-a91d-df017df61108 req-56c3688c-f331-4a88-9e57-01ded702c8b4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-ad27380e-6bd5-432d-a91d-df017df61108 req-56c3688c-f331-4a88-9e57-01ded702c8b4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-7488ca92-48aa-4e23-a4bf-e27d9145040c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e2dc662-66cb-4b97-9fdf-e8027c9cee96', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:10:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-ad27380e-6bd5-432d-a91d-df017df61108 req-56c3688c-f331-4a88-9e57-01ded702c8b4 tempest-TestInstancesWithCinderVolumes-1424705724 None] attachment_update completed successfully. Nov 04 19:10:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=77,cinder:SELECT=77,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=77,cinder:SELECT=89,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-d55f4d98-1c68-46c5-bbd8-5641bee8c238 req-9f6e80fa-2a83-48c0-8bf6-6c6fc69da538 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-d55f4d98-1c68-46c5-bbd8-5641bee8c238 req-9f6e80fa-2a83-48c0-8bf6-6c6fc69da538 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-d55f4d98-1c68-46c5-bbd8-5641bee8c238 req-9f6e80fa-2a83-48c0-8bf6-6c6fc69da538 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-d55f4d98-1c68-46c5-bbd8-5641bee8c238 req-9f6e80fa-2a83-48c0-8bf6-6c6fc69da538 tempest-TestInstancesWithCinderVolumes-1424705724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa54ac4-95c3-4692-88f4-cf6e4859e00d', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:10:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-d55f4d98-1c68-46c5-bbd8-5641bee8c238 req-9f6e80fa-2a83-48c0-8bf6-6c6fc69da538 tempest-TestInstancesWithCinderVolumes-1424705724 None] attachment_update completed successfully. Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Flow 'volume_create_manager' (245c659e-9e9a-4d8a-aacf-1d9f29dfb6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ffd588-6fde-4374-8771-d1d0fa45900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ffd588-6fde-4374-8771-d1d0fa45900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1538367971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f341912-97a5-464a-a36a-4bf104cb26ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc0910dba09444881e895d5783aba3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:15Z,use_quota=True,user_id='17a355c19d1549698d820149c388bf67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f919c5bd-f1cb-4a17-b508-bfc9fdc873af),volume_type_id=f919c5bd-f1cb-4a17-b508-bfc9fdc873af)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521f2512-8749-4580-ae65-b1306c4609c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521f2512-8749-4580-ae65-b1306c4609c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcbd593-0f0e-4d0b-b06b-c39d4865bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcbd593-0f0e-4d0b-b06b-c39d4865bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f341912-97a5-464a-a36a-4bf104cb26ad', 'volume_name': 'volume-4f341912-97a5-464a-a36a-4bf104cb26ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49aa1c9d-7c4f-4545-93e0-259789101052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49aa1c9d-7c4f-4545-93e0-259789101052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab7be9-ae3b-4974-a897-3dee1cf3afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:15 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Volume 4f341912-97a5-464a-a36a-4bf104cb26ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f341912-97a5-464a-a36a-4bf104cb26ad', 'volume_size': 1} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1538367971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f341912-97a5-464a-a36a-4bf104cb26ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc0910dba09444881e895d5783aba3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:15Z,use_quota=True,user_id='17a355c19d1549698d820149c388bf67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f919c5bd-f1cb-4a17-b508-bfc9fdc873af),volume_type_id=f919c5bd-f1cb-4a17-b508-bfc9fdc873af)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Creating volume 4f341912-97a5-464a-a36a-4bf104cb26ad {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:15 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:15 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad 1073741824 Nov 04 19:10:15 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:15 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad 1073741824" returned: 0 in 0.505s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:15 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad Nov 04 19:10:15 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:16 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab7be9-ae3b-4974-a897-3dee1cf3afb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f341912-97a5-464a-a36a-4bf104cb26ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b534c4-4a9a-4bd9-80c4-761e07a9d9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:16 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Volume volume-4f341912-97a5-464a-a36a-4bf104cb26ad (4f341912-97a5-464a-a36a-4bf104cb26ad): created successfully Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b534c4-4a9a-4bd9-80c4-761e07a9d9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Flow 'volume_create_manager' (245c659e-9e9a-4d8a-aacf-1d9f29dfb6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-486d2e64-95e8-45d1-8517-90e798b0f86f tempest-VolumeTypesAccessTest-2006219034 None] Created volume successfully. Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Acquiring lock "cinder-4f341912-97a5-464a-a36a-4bf104cb26ad-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "cinder-4f341912-97a5-464a-a36a-4bf104cb26ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Acquiring lock "cinder-quobyte-4f341912-97a5-464a-a36a-4bf104cb26ad" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "cinder-quobyte-4f341912-97a5-464a-a36a-4bf104cb26ad" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[181041da-66fc-4dfc-baaa-520bd857f80e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:17 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad Nov 04 19:10:17 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:17 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad" returned: 0 in 0.438s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:17 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad Nov 04 19:10:17 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:18 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4f341912-97a5-464a-a36a-4bf104cb26ad" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "cinder-quobyte-4f341912-97a5-464a-a36a-4bf104cb26ad" released by "delete_volume" :: held 0.775s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:18 devstack cinder-volume[87367]: WARNING cinder.quota [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1006865324 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1006865324, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:18 devstack cinder-volume[87367]: WARNING cinder.quota [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1006865324 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1006865324, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Created reservations ['d4799c2d-b0ca-40cb-8f58-7142676ff7a0', '0ba817f5-e8f9-4b29-b3d6-9333cabb936e', '62e5ba83-733e-4d8c-a61b-3f1615cc6c43', '67e97d0e-174a-4d57-8bf2-7f4e50f8152d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:18 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:18 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:18 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Deleted volume successfully. Nov 04 19:10:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-06f01489-d63d-4d9b-81e6-0f75ce87951f tempest-VolumeTypesAccessTest-2006219034 None] Lock "cinder-4f341912-97a5-464a-a36a-4bf104cb26ad-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-05db5f27-a1ae-4d06-93a6-20edbd63e65d req-3b843340-0a7a-4273-94b3-a71995223036 tempest-TestInstancesWithCinderVolumes-1424705724 None] Terminate volume connection completed successfully. Nov 04 19:10:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-05db5f27-a1ae-4d06-93a6-20edbd63e65d req-3b843340-0a7a-4273-94b3-a71995223036 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleting attachment 7e2dc662-66cb-4b97-9fdf-e8027c9cee96. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:10:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-7488ca92-48aa-4e23-a4bf-e27d9145040c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-7488ca92-48aa-4e23-a4bf-e27d9145040c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-quobyte-7488ca92-48aa-4e23-a4bf-e27d9145040c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-7488ca92-48aa-4e23-a4bf-e27d9145040c" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf17d9-4abb-4c7c-9b83-1a21de499b73]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:20 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c Nov 04 19:10:20 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:20 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c" returned: 0 in 0.569s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:20 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c Nov 04 19:10:20 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:20 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7488ca92-48aa-4e23-a4bf-e27d9145040c" returned: 0 in 0.327s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-7488ca92-48aa-4e23-a4bf-e27d9145040c" released by "delete_volume" :: held 0.991s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:21 devstack cinder-volume[87367]: WARNING cinder.quota [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-930062294-818069564 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-930062294-818069564, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:21 devstack cinder-volume[87367]: WARNING cinder.quota [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-930062294-818069564 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-930062294-818069564, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Created reservations ['c2b1ed92-287a-4d07-8eec-38a9bc318c16', 'c467421b-5e28-4278-87bc-a314bcdacb7e', 'b16150b5-e050-4180-b14b-9ff4aede780c', 'ad352d8f-f262-47e2-9301-a6f956f59834'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:21 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:21 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:21 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.330s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleted volume successfully. Nov 04 19:10:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-afaee5ed-6683-42f0-965d-3f71deccab96 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-7488ca92-48aa-4e23-a4bf-e27d9145040c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:22 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:22 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:22 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.464s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:10:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:10:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-2baf6183-0114-4014-b22c-613a86bdc837 req-c9a376ce-67d2-4892-af7a-cf315d63f2fd tempest-AttachVolumeTestJSON-1877871074 None] Terminate volume connection completed successfully. Nov 04 19:10:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-2baf6183-0114-4014-b22c-613a86bdc837 req-c9a376ce-67d2-4892-af7a-cf315d63f2fd tempest-AttachVolumeTestJSON-1877871074 None] Deleting attachment fe979023-0927-449c-83ef-1fbac04bdbc6. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:10:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-14018d49-c723-4dc4-a174-711e5a11b62b req-611ba306-2a46-4cd1-b4cc-3bd0145dd8c4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Terminate volume connection completed successfully. Nov 04 19:10:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-14018d49-c723-4dc4-a174-711e5a11b62b req-611ba306-2a46-4cd1-b4cc-3bd0145dd8c4 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleting attachment baa54ac4-95c3-4692-88f4-cf6e4859e00d. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:10:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-d3cce9a2-cb91-4c72-819d-0f3b48706ea1-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-d3cce9a2-cb91-4c72-819d-0f3b48706ea1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-quobyte-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae003cd-de8e-41bb-993f-571dab0ba5e5]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:26 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 Nov 04 19:10:26 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:26 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" returned: 0 in 0.538s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:26 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1 Nov 04 19:10:26 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:26 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" returned: 0 in 0.324s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-d3cce9a2-cb91-4c72-819d-0f3b48706ea1" released by "delete_volume" :: held 0.969s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:26 devstack cinder-volume[87367]: WARNING cinder.quota [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2077326144-1869501936 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2077326144-1869501936, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:26 devstack cinder-volume[87367]: WARNING cinder.quota [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2077326144-1869501936 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2077326144-1869501936, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:26 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Created reservations ['6bed95ba-e466-447f-9a8e-23a1083e49df', '0d462aa5-1024-4bdd-b119-3d2f5d5f3f2b', 'd54899dc-113b-4a4f-b05f-cc15a781d6be', 'd2febc5a-784c-48e3-8870-954f1d1c04da'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:27 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:27 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:27 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.368s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleted volume successfully. Nov 04 19:10:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8fedb990-b03a-47f2-8874-a84a682e0bab tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-d3cce9a2-cb91-4c72-819d-0f3b48706ea1-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Flow 'volume_create_manager' (22c99a9a-9b29-468c-a6a9-4a98392c2d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d736fd-d940-4c93-bd5a-468e7e8b1078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d736fd-d940-4c93-bd5a-468e7e8b1078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-674089362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430864c6-9e1d-43cb-a8cc-5319b3a008e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ac3f1c81145819619df1cba8adc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:37Z,use_quota=True,user_id='b62f0017bddd4f04824b2398758d1e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bde114-496b-4d4c-a744-e8405ad6d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bde114-496b-4d4c-a744-e8405ad6d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b677897-83d1-4d4b-9a1b-0cf000ce5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b677897-83d1-4d4b-9a1b-0cf000ce5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430864c6-9e1d-43cb-a8cc-5319b3a008e7', 'volume_name': 'volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e62bf7-ca7a-4937-935e-836622331f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e62bf7-ca7a-4937-935e-836622331f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3438d368-98f2-4ddc-9849-871f1d62784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:37 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Volume 430864c6-9e1d-43cb-a8cc-5319b3a008e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7', 'volume_size': 1} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-674089362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430864c6-9e1d-43cb-a8cc-5319b3a008e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ac3f1c81145819619df1cba8adc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:37Z,use_quota=True,user_id='b62f0017bddd4f04824b2398758d1e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Creating volume 430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:37 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:10:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:37 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 1073741824 Nov 04 19:10:37 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:38 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 1073741824" returned: 0 in 1.210s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:39 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:10:39 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:39 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.388s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3438d368-98f2-4ddc-9849-871f1d62784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510147bb-31ab-4178-90b9-8bf31b64002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Volume volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 (430864c6-9e1d-43cb-a8cc-5319b3a008e7): created successfully Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510147bb-31ab-4178-90b9-8bf31b64002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Flow 'volume_create_manager' (22c99a9a-9b29-468c-a6a9-4a98392c2d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1d441b92-8b7b-4881-a6e5-fd51403e28f6 tempest-TestStampPattern-731719087 None] Created volume successfully. Nov 04 19:10:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-2d92ca73-f7fd-4d2f-b123-458638dcb0a8 req-6c2c48d6-7859-4a6a-9cdd-07caa36f0bb7 tempest-TestInstancesWithCinderVolumes-1424705724 None] Terminate volume connection completed successfully. Nov 04 19:10:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-2d92ca73-f7fd-4d2f-b123-458638dcb0a8 req-6c2c48d6-7859-4a6a-9cdd-07caa36f0bb7 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleting attachment f5cfaaa3-cdfe-41ad-aeda-d9d0ecf65341. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:10:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-66c33bad-213f-453c-b7ac-d68972e46201-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-66c33bad-213f-453c-b7ac-d68972e46201-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "cinder-quobyte-66c33bad-213f-453c-b7ac-d68972e46201" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-66c33bad-213f-453c-b7ac-d68972e46201" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[74123f50-342b-4f62-b60a-0cd8babd051d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:42 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 Nov 04 19:10:42 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:42 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201" returned: 0 in 0.699s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:43 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201 Nov 04 19:10:43 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:43 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-66c33bad-213f-453c-b7ac-d68972e46201" returned: 0 in 0.481s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-quobyte-66c33bad-213f-453c-b7ac-d68972e46201" released by "delete_volume" :: held 1.322s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:43 devstack cinder-volume[87367]: WARNING cinder.quota [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411093214-1889004753 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411093214-1889004753, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:43 devstack cinder-volume[87367]: WARNING cinder.quota [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411093214-1889004753 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-411093214-1889004753, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Created reservations ['652519de-fc1b-4907-aa83-bcda040f5dfc', 'dca37bcb-2e77-40b3-9f4d-eebf3345835b', '388a530a-0969-45c2-8b66-775ebe2625f6', '4b3cb71e-6609-4285-ad53-111154c27ef0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:43 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:10:43 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:44 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.499s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:44 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Deleted volume successfully. Nov 04 19:10:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7f395226-d2eb-47d9-992c-4a44aa1b35c9 tempest-TestInstancesWithCinderVolumes-1424705724 None] Lock "cinder-66c33bad-213f-453c-b7ac-d68972e46201-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:53 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:54 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=32,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Flow 'volume_create_manager' (7b67120a-d9c6-4f51-863a-b7ad6f036574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd66d6d9-93c7-46f6-9af6-cd70afae2241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd66d6d9-93c7-46f6-9af6-cd70afae2241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2101963555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a76740d-9602-43c0-8f28-0562cac9d216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbcdaba5dd84f099a20a4325afe5516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:57Z,use_quota=True,user_id='0473870f7bd542fd9acb9a2b02093386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e680b6b5-e6db-48df-b1f6-eb5967bd1267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e680b6b5-e6db-48df-b1f6-eb5967bd1267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8199bbd-e6f2-46df-b31c-0962e1b2add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8199bbd-e6f2-46df-b31c-0962e1b2add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a76740d-9602-43c0-8f28-0562cac9d216', 'volume_name': 'volume-5a76740d-9602-43c0-8f28-0562cac9d216', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a739d05c-1780-4d6a-a965-c8b79e5ec4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a739d05c-1780-4d6a-a965-c8b79e5ec4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a42565-5cd3-4b77-a5cd-ab0d16a710f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Volume 5a76740d-9602-43c0-8f28-0562cac9d216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a76740d-9602-43c0-8f28-0562cac9d216', 'volume_size': 1} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2101963555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a76740d-9602-43c0-8f28-0562cac9d216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbcdaba5dd84f099a20a4325afe5516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:57Z,use_quota=True,user_id='0473870f7bd542fd9acb9a2b02093386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Creating volume 5a76740d-9602-43c0-8f28-0562cac9d216 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:56 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:10:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:56 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 1073741824 Nov 04 19:10:56 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:57 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 1073741824" returned: 0 in 0.511s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:57 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 Nov 04 19:10:57 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:57 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216" returned: 0 in 0.383s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a42565-5cd3-4b77-a5cd-ab0d16a710f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a76740d-9602-43c0-8f28-0562cac9d216', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d266e-25fc-4ee4-aca0-5f12bab43ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Volume volume-5a76740d-9602-43c0-8f28-0562cac9d216 (5a76740d-9602-43c0-8f28-0562cac9d216): created successfully Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416d266e-25fc-4ee4-aca0-5f12bab43ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Flow 'volume_create_manager' (7b67120a-d9c6-4f51-863a-b7ad6f036574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-feccea83-1338-4a24-b84b-ab9a83b5e679 tempest-AbsoluteLimitsTests-574303729 None] Created volume successfully. Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Acquiring lock "cinder-5a76740d-9602-43c0-8f28-0562cac9d216-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "cinder-5a76740d-9602-43c0-8f28-0562cac9d216-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Acquiring lock "cinder-quobyte-5a76740d-9602-43c0-8f28-0562cac9d216" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "cinder-quobyte-5a76740d-9602-43c0-8f28-0562cac9d216" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c3e70-07e8-4659-9c9d-d17b4576ed62]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:59 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 Nov 04 19:10:59 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:00 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216" returned: 0 in 0.507s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:00 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216 Nov 04 19:11:00 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:00 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5a76740d-9602-43c0-8f28-0562cac9d216" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "cinder-quobyte-5a76740d-9602-43c0-8f28-0562cac9d216" released by "delete_volume" :: held 0.949s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Created reservations ['5cab2598-0466-45b5-9cb3-4a2da6648c9f', '6038cee4-7d28-49cb-8ce3-6c194b7df71e', 'bfd60988-6531-4e45-80ef-1cc3e23f4209', '7af802d3-02ec-4e2a-9b8e-db69b0bef440'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:00 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:11:00 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:01 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.273s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:01 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Deleted volume successfully. Nov 04 19:11:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-adef77c5-5d19-461e-b0dd-31f633991daa tempest-AbsoluteLimitsTests-574303729 None] Lock "cinder-5a76740d-9602-43c0-8f28-0562cac9d216-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:10 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:11:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Flow 'volume_create_manager' (84e0ae61-9842-442d-8d25-aa1d23873805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6148e6-aa53-44ac-b193-f1929c166700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6148e6-aa53-44ac-b193-f1929c166700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1767854528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0d20a-7796-4d41-8369-4126d1c9effc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816fcfe4faa3477ab5525ca84352a3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:12Z,use_quota=True,user_id='c38f4b7e6f7b4606b6a19a7c5674a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20204def-6af3-4612-a4e6-f26b4cc8b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20204def-6af3-4612-a4e6-f26b4cc8b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee826a23-45b7-4761-ae4c-3343ea7e9f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee826a23-45b7-4761-ae4c-3343ea7e9f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb0d20a-7796-4d41-8369-4126d1c9effc', 'volume_name': 'volume-6fb0d20a-7796-4d41-8369-4126d1c9effc', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4020a80-394a-4ed4-9fce-f1d0cdbdf7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4020a80-394a-4ed4-9fce-f1d0cdbdf7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b20c32d-1d55-404b-ab06-1b4b41e14bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:12 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Volume 6fb0d20a-7796-4d41-8369-4126d1c9effc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb0d20a-7796-4d41-8369-4126d1c9effc', 'volume_size': 1} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1767854528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0d20a-7796-4d41-8369-4126d1c9effc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816fcfe4faa3477ab5525ca84352a3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:12Z,use_quota=True,user_id='c38f4b7e6f7b4606b6a19a7c5674a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Creating volume 6fb0d20a-7796-4d41-8369-4126d1c9effc {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:12 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:12 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc 1073741824 Nov 04 19:11:12 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:12 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc 1073741824" returned: 0 in 0.528s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:12 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc Nov 04 19:11:12 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:13 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc" returned: 0 in 0.335s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b20c32d-1d55-404b-ab06-1b4b41e14bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb0d20a-7796-4d41-8369-4126d1c9effc', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac0c964-d0a3-4408-ac7c-9d4456a3e3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Volume volume-6fb0d20a-7796-4d41-8369-4126d1c9effc (6fb0d20a-7796-4d41-8369-4126d1c9effc): created successfully Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac0c964-d0a3-4408-ac7c-9d4456a3e3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Flow 'volume_create_manager' (84e0ae61-9842-442d-8d25-aa1d23873805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f1c13b9a-ab33-4c42-9f59-14c3c401c4ca tempest-VolumesTransfersV357Test-1685916007 None] Created volume successfully. Nov 04 19:11:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b125f25b-a471-4807-b2e4-9e2d5e335eef tempest-VolumesTransfersV357Test-2118356679 None] Transfer volume completed successfully. Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "cinder-6fb0d20a-7796-4d41-8369-4126d1c9effc-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-6fb0d20a-7796-4d41-8369-4126d1c9effc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "cinder-quobyte-6fb0d20a-7796-4d41-8369-4126d1c9effc" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-quobyte-6fb0d20a-7796-4d41-8369-4126d1c9effc" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27d90f-a8b4-43fa-b208-ea6b2eb152a4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:16 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc Nov 04 19:11:16 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:17 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:17 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc Nov 04 19:11:17 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:17 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fb0d20a-7796-4d41-8369-4126d1c9effc" returned: 0 in 0.294s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-quobyte-6fb0d20a-7796-4d41-8369-4126d1c9effc" released by "delete_volume" :: held 0.891s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Created reservations ['dadc74d6-b477-4912-9206-971e58ef6b87', '0a956fbc-0721-4330-bedd-60420b240b64', '757af7f3-936d-4953-922f-c84f366cc817', '4dab105b-7c2f-4b3c-9238-fddb1ca2ede4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:17 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:11:17 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:17 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.268s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:17 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Deleted volume successfully. Nov 04 19:11:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-88d76702-046d-4b2b-8891-e9046817a6d4 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-6fb0d20a-7796-4d41-8369-4126d1c9effc-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Flow 'volume_create_manager' (de069b3f-96eb-49d6-b205-c9c67dcedeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20db890-4c53-4ab5-8927-37226b91eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20db890-4c53-4ab5-8927-37226b91eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1341634044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a8ab0a-f95d-4583-a05c-053dca4fa80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816fcfe4faa3477ab5525ca84352a3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:19Z,use_quota=True,user_id='c38f4b7e6f7b4606b6a19a7c5674a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d31c5ef-0ae2-4f26-bfe5-2c7d0f1e9413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d31c5ef-0ae2-4f26-bfe5-2c7d0f1e9413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b2c6fc-9bc5-4697-b4e6-2e094092d0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b2c6fc-9bc5-4697-b4e6-2e094092d0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a8ab0a-f95d-4583-a05c-053dca4fa80c', 'volume_name': 'volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74878810-4b41-4392-adb9-137a7b292db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74878810-4b41-4392-adb9-137a7b292db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6548d29-0a4b-497e-890f-557937f96478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Volume 94a8ab0a-f95d-4583-a05c-053dca4fa80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c', 'volume_size': 1} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1341634044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a8ab0a-f95d-4583-a05c-053dca4fa80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='816fcfe4faa3477ab5525ca84352a3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:19Z,use_quota=True,user_id='c38f4b7e6f7b4606b6a19a7c5674a970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Creating volume 94a8ab0a-f95d-4583-a05c-053dca4fa80c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:19 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:11:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:19 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c 1073741824 Nov 04 19:11:19 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:20 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c 1073741824" returned: 0 in 0.896s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:20 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c Nov 04 19:11:20 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:21 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c" returned: 0 in 0.636s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6548d29-0a4b-497e-890f-557937f96478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3390abf-91e8-4428-ba88-63320a6e9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Volume volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c (94a8ab0a-f95d-4583-a05c-053dca4fa80c): created successfully Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3390abf-91e8-4428-ba88-63320a6e9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Flow 'volume_create_manager' (de069b3f-96eb-49d6-b205-c9c67dcedeb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-242a1851-5687-4a08-b1fb-21b1fcaf7bad tempest-VolumesTransfersV357Test-1685916007 None] Created volume successfully. Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-73bb3c5e-91e1-4bc2-988b-c701e8515e5d req-1dfc69b7-5564-439c-bb8b-5a509a73b894 tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-73bb3c5e-91e1-4bc2-988b-c701e8515e5d req-1dfc69b7-5564-439c-bb8b-5a509a73b894 tempest-TestStampPattern-731719087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-73bb3c5e-91e1-4bc2-988b-c701e8515e5d req-1dfc69b7-5564-439c-bb8b-5a509a73b894 tempest-TestStampPattern-731719087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-73bb3c5e-91e1-4bc2-988b-c701e8515e5d req-1dfc69b7-5564-439c-bb8b-5a509a73b894 tempest-TestStampPattern-731719087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61b7742b-154d-4606-8d1b-d3a1f2c1587b', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:11:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-73bb3c5e-91e1-4bc2-988b-c701e8515e5d req-1dfc69b7-5564-439c-bb8b-5a509a73b894 tempest-TestStampPattern-731719087 None] attachment_update completed successfully. Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:22 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:11:22 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "cinder-94a8ab0a-f95d-4583-a05c-053dca4fa80c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-94a8ab0a-f95d-4583-a05c-053dca4fa80c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "cinder-quobyte-94a8ab0a-f95d-4583-a05c-053dca4fa80c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-quobyte-94a8ab0a-f95d-4583-a05c-053dca4fa80c" acquired by "delete_volume" :: waited 0.041s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6284a-47e3-408a-9c03-a7f8427ff262]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:22 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.646s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:11:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:11:23 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c Nov 04 19:11:23 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:23 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c" returned: 0 in 0.751s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:23 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c Nov 04 19:11:23 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:23 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-94a8ab0a-f95d-4583-a05c-053dca4fa80c" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-quobyte-94a8ab0a-f95d-4583-a05c-053dca4fa80c" released by "delete_volume" :: held 1.222s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:23 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Created reservations ['d80a9f90-9c52-4471-83a9-405a3a204b1f', 'b03ebc0e-b448-4f78-9415-bd1ea77f852c', '17115833-c44f-4fbd-858a-0bfd89f5d787', 'db8705ca-291b-4de3-aeac-11bea2046add'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:24 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:11:24 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:24 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Deleted volume successfully. Nov 04 19:11:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3862e2a8-66bb-41ef-a1f7-848c7b02ccf0 tempest-VolumesTransfersV357Test-1838215130 None] Lock "cinder-94a8ab0a-f95d-4583-a05c-053dca4fa80c-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-591b74e9-435d-469e-9191-d0a840e1ca6f req-d5c6cd19-64a4-4787-b5d5-c9f2ab158dc2 tempest-TestStampPattern-731719087 None] Terminate volume connection completed successfully. Nov 04 19:11:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-591b74e9-435d-469e-9191-d0a840e1ca6f req-d5c6cd19-64a4-4787-b5d5-c9f2ab158dc2 tempest-TestStampPattern-731719087 None] Deleting attachment 61b7742b-154d-4606-8d1b-d3a1f2c1587b. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:11:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Creating offline snapshot 82a17576-379a-4859-ac92-814e272997d0 of volume 430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:11:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[919dca73-4d89-4a3a-98a9-d012fd63ed8b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:30 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:11:30 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:31 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.652s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:31 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 1G Nov 04 19:11:31 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:32 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 1G" returned: 0 in 0.759s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:32 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:11:32 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:32 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:32 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 is being set with open permissions: ugo+rw Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:32 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:11:32 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:32 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.372s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:33 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info Nov 04 19:11:33 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:33 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info" returned: 0 in 0.357s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:33 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info is being set with open permissions: ugo+rw Nov 04 19:11:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:33 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info Nov 04 19:11:33 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:33 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.info" returned: 0 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.179s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-df3466b4-ac5f-47f8-a6d0-01b904651e5b tempest-TestStampPattern-731719087 None] Create snapshot completed successfully Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Flow 'volume_create_manager' (775b461c-ce7f-41e7-b2e4-9301eab22ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b30f9df-8dac-4868-95b1-1c909f3ba4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b30f9df-8dac-4868-95b1-1c909f3ba4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1921682759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac231c6a-13bf-4462-9f89-a81ab1ebb47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606ef329c88248cd83bc323a238e04ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:37Z,use_quota=True,user_id='71cf8875e5514d618af80b823db33d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1e87dd-5374-41d1-8f34-7f8404fb2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1e87dd-5374-41d1-8f34-7f8404fb2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fc975e-4c76-4bf9-94b6-1c6dd2799540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fc975e-4c76-4bf9-94b6-1c6dd2799540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac231c6a-13bf-4462-9f89-a81ab1ebb47d', 'volume_name': 'volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd2e3a7-7888-4da7-a73b-55e84008fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd2e3a7-7888-4da7-a73b-55e84008fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399143e9-ec1b-4848-ae43-2280df788f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:11:37 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Trying to clone ac231c6a-13bf-4462-9f89-a81ab1ebb47d from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:11:38 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86fcf49-1273-4539-89e3-10b6c25a0668]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD Nov 04 19:11:38 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 is fetched for user 71cf8875e5514d618af80b823db33d3c. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[334636af-0cc9-4911-a95c-59c907255136]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD Nov 04 19:11:38 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1921682759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac231c6a-13bf-4462-9f89-a81ab1ebb47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606ef329c88248cd83bc323a238e04ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:37Z,use_quota=True,user_id='71cf8875e5514d618af80b823db33d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Creating volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:39 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1073741824 Nov 04 19:11:39 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1073741824" returned: 0 in 0.572s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d Nov 04 19:11:39 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Attempting download of 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[77531e70-5dc9-465f-b469-e255cb891c74]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl Nov 04 19:11:40 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl" returned: 0 in 0.399s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl Nov 04 19:11:41 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl" returned: 1 in 0.393s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_u_vephsl' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0750eb2-2f8b-4623-8a52-3ecd6c051e75]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD Nov 04 19:11:41 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] 4ddc0397-cfae-4b65-9580-9560490b2ca6 was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:11:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d Nov 04 19:11:41 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Flow 'volume_create_manager' (526d4ad6-a7e5-486d-933c-51e659a922f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44547750-4614-4bbd-865e-15d8054f650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44547750-4614-4bbd-865e-15d8054f650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-364255465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624f2200-5c50-4452-9b88-9a0497bfcb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ac3f1c81145819619df1cba8adc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82a17576-379a-4859-ac92-814e272997d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:44Z,use_quota=True,user_id='b62f0017bddd4f04824b2398758d1e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6b78b2-5b42-4c3e-9463-269220b48f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6b78b2-5b42-4c3e-9463-269220b48f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda45b22-0fd7-4a84-946b-6143d37c6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda45b22-0fd7-4a84-946b-6143d37c6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '624f2200-5c50-4452-9b88-9a0497bfcb07', 'volume_name': 'volume-624f2200-5c50-4452-9b88-9a0497bfcb07', 'volume_size': 1, 'snapshot_id': '82a17576-379a-4859-ac92-814e272997d0'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1e7e07-7f41-43ee-b84f-1e775dcc7917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1e7e07-7f41-43ee-b84f-1e775dcc7917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f21b9f-f9a7-4c48-9fee-5a46dc9e5829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Volume 624f2200-5c50-4452-9b88-9a0497bfcb07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-624f2200-5c50-4452-9b88-9a0497bfcb07', 'volume_size': 1, 'snapshot_id': '82a17576-379a-4859-ac92-814e272997d0'} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0-624f2200-5c50-4452-9b88-9a0497bfcb07" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0-624f2200-5c50-4452-9b88-9a0497bfcb07" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Creating volume 624f2200-5c50-4452-9b88-9a0497bfcb07 from snapshot 82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] snapshot: 82a17576-379a-4859-ac92-814e272997d0, volume: 624f2200-5c50-4452-9b88-9a0497bfcb07, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa2eb4-39a7-4306-8306-4cc7d67ed528]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" returned: 0 in 3.449s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_447ab2bqdevstack@QuobyteHD, size 112.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:11:45 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Converted 112.00 MB image at 32.45 MB/s Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1G Nov 04 19:11:45 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:11:45 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.779s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589cf4d-c4b6-4626-b32c-f817de331ff8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 1G" returned: 0 in 0.820s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Downloaded image 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 for user 71cf8875e5514d618af80b823db33d3c is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Marking volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:11:46 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:11:46 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Copying metadata from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 to ac231c6a-13bf-4462-9f89-a81ab1ebb47d. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Creating volume glance metadata for volume ac231c6a-13bf-4462-9f89-a81ab1ebb47d backed by image 4ddc0397-cfae-4b65-9580-9560490b2ca6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399143e9-ec1b-4848-ae43-2280df788f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e3243-66f3-492b-84f2-dad2d3a2dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Volume volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d (ac231c6a-13bf-4462-9f89-a81ab1ebb47d): created successfully Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e3243-66f3-492b-84f2-dad2d3a2dd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Flow 'volume_create_manager' (775b461c-ce7f-41e7-b2e4-9301eab22ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2dc703ba-cc4a-4415-85bb-5e10b9a31a92 tempest-VolumesExtendTest-360583250 None] Created volume successfully. Nov 04 19:11:46 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.702s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:11:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 Nov 04 19:11:46 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (32bf6794-45b4-4257-971b-875602649a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7757ae24-011f-423e-a0da-eab6bcb24768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7757ae24-011f-423e-a0da-eab6bcb24768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1073849012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521b6dd4-5427-417c-9d56-ec48caa20034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:47Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52a36f4-6e6f-48a7-8163-23cb619ffc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52a36f4-6e6f-48a7-8163-23cb619ffc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caac33d-6a68-4323-bc42-672a0d59e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caac33d-6a68-4323-bc42-672a0d59e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521b6dd4-5427-417c-9d56-ec48caa20034', 'volume_name': 'volume-521b6dd4-5427-417c-9d56-ec48caa20034', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef4840-c5ff-4969-b8ed-645b2344491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef4840-c5ff-4969-b8ed-645b2344491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3c93ab-b933-481b-ad1b-5a49370d684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Volume 521b6dd4-5427-417c-9d56-ec48caa20034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521b6dd4-5427-417c-9d56-ec48caa20034', 'volume_size': 1} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Flow 'volume_create_manager' (97efde78-5df9-4023-b9dd-742659a994b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ec8997-b9c6-49e5-9575-aaba3902048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ec8997-b9c6-49e5-9575-aaba3902048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1178016982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bd8ef3-0a86-43b4-bebd-e48800b5275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f702d82f0453384ce16ecdc3bb813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:57Z,use_quota=True,user_id='fad4bdbd9ee3470cab31f880398a3bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a4e85-707e-4f5d-a1ca-383c325ef918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a4e85-707e-4f5d-a1ca-383c325ef918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3ed7ef-1395-4fbc-a1cf-d3b75a3db306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3ed7ef-1395-4fbc-a1cf-d3b75a3db306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bd8ef3-0a86-43b4-bebd-e48800b5275b', 'volume_name': 'volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8141115-7e3a-479e-bb41-9f27132f9a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8141115-7e3a-479e-bb41-9f27132f9a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83513b-f908-426e-828c-7214ef072503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Volume 58bd8ef3-0a86-43b4-bebd-e48800b5275b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b', 'volume_size': 1} Nov 04 19:11:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:59 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07" returned: 0 in 13.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7, size 1024.00 MB, duration 13.36 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:11:59 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Converted 1024.00 MB image at 76.62 MB/s Nov 04 19:11:59 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 is being set with open permissions: ugo+rw Nov 04 19:11:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 Nov 04 19:11:59 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:00 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07" returned: 0 in 0.524s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" released by "_copy_volume_from_snapshot" :: held 15.570s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0-624f2200-5c50-4452-9b88-9a0497bfcb07" released by "_create_volume_from_snapshot" :: held 15.695s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.737s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.084s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1073849012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521b6dd4-5427-417c-9d56-ec48caa20034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:47Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Creating volume 521b6dd4-5427-417c-9d56-ec48caa20034 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:00 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:00 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 1073741824 Nov 04 19:12:00 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f21b9f-f9a7-4c48-9fee-5a46dc9e5829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624f2200-5c50-4452-9b88-9a0497bfcb07', 'volume_size': 1, 'snapshot_id': '82a17576-379a-4859-ac92-814e272997d0'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60254329-6ba8-4d97-a650-476e16efd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:00 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Volume volume-624f2200-5c50-4452-9b88-9a0497bfcb07 (624f2200-5c50-4452-9b88-9a0497bfcb07): created successfully Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60254329-6ba8-4d97-a650-476e16efd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Flow 'volume_create_manager' (526d4ad6-a7e5-486d-933c-51e659a922f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6a70d306-2d84-44bb-96db-28b071ee702d tempest-TestStampPattern-731719087 None] Created volume successfully. Nov 04 19:12:01 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 1073741824" returned: 0 in 0.745s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 Nov 04 19:12:01 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034" returned: 0 in 0.392s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 14.127s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3c93ab-b933-481b-ad1b-5a49370d684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521b6dd4-5427-417c-9d56-ec48caa20034', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8bd918-42aa-4feb-bf4e-ed869462ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f5b9f7-be1e-4d85-9a5b-c3bd7bdd34ce]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Volume volume-521b6dd4-5427-417c-9d56-ec48caa20034 (521b6dd4-5427-417c-9d56-ec48caa20034): created successfully Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8bd918-42aa-4feb-bf4e-ed869462ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (32bf6794-45b4-4257-971b-875602649a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-80594e50-d487-40d9-a695-196796f91cd7 tempest-AttachVolumeTestJSON-1877871074 None] Created volume successfully. Nov 04 19:12:02 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d Nov 04 19:12:02 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" returned: 0 in 0.621s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 2G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d 2G" returned: 0 in 0.123s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.818s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.366s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1178016982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bd8ef3-0a86-43b4-bebd-e48800b5275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f702d82f0453384ce16ecdc3bb813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:57Z,use_quota=True,user_id='fad4bdbd9ee3470cab31f880398a3bef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Creating volume 58bd8ef3-0a86-43b4-bebd-e48800b5275b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:02 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b 1073741824 Nov 04 19:12:02 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1d6708d4-1c58-460e-a3ef-5b817d9e8cbf tempest-VolumesExtendTest-360583250 None] Extend volume completed successfully. Nov 04 19:12:03 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b 1073741824" returned: 0 in 0.973s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:03 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b Nov 04 19:12:03 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:04 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b" returned: 0 in 0.531s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83513b-f908-426e-828c-7214ef072503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97473b08-a396-47df-943a-e671b165620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-ac231c6a-13bf-4462-9f89-a81ab1ebb47d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Volume volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b (58bd8ef3-0a86-43b4-bebd-e48800b5275b): created successfully Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97473b08-a396-47df-943a-e671b165620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Flow 'volume_create_manager' (97efde78-5df9-4023-b9dd-742659a994b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "cinder-ac231c6a-13bf-4462-9f89-a81ab1ebb47d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3b923841-aa27-404e-bbb4-ebbba3771cc5 req-154a4cfd-6cc5-4b8c-afb3-fb03cfd99218 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3b923841-aa27-404e-bbb4-ebbba3771cc5 req-154a4cfd-6cc5-4b8c-afb3-fb03cfd99218 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-479e95ca-fb56-4920-8b4c-5b525c280a71 tempest-TestMinimumBasicScenario-283597140 None] Created volume successfully. Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3b923841-aa27-404e-bbb4-ebbba3771cc5 req-154a4cfd-6cc5-4b8c-afb3-fb03cfd99218 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-quobyte-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-3b923841-aa27-404e-bbb4-ebbba3771cc5 req-154a4cfd-6cc5-4b8c-afb3-fb03cfd99218 tempest-AttachVolumeTestJSON-1877871074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-521b6dd4-5427-417c-9d56-ec48caa20034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c05c1017-6016-4f8a-aa39-980e299f00b1', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" acquired by "delete_volume" :: waited 0.050s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0995526-20b0-42e2-a510-1f808e28b174]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-3b923841-aa27-404e-bbb4-ebbba3771cc5 req-154a4cfd-6cc5-4b8c-afb3-fb03cfd99218 tempest-AttachVolumeTestJSON-1877871074 None] attachment_update completed successfully. Nov 04 19:12:04 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d Nov 04 19:12:04 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:05 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" returned: 0 in 1.020s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:05 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d Nov 04 19:12:05 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:06 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" returned: 0 in 0.586s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-ac231c6a-13bf-4462-9f89-a81ab1ebb47d" released by "delete_volume" :: held 1.721s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Created reservations ['f45085d7-db3a-4492-83f0-92728c9d1ad5', '15c1b2fe-49d6-47a2-9fa8-2cf300125751', 'fc352d98-14ce-4bf1-a16f-ec176e62754f', '9f2cf49d-23d3-489e-983b-be29f741058a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:06 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:06 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-68b34db1-9d77-448e-a300-8cffa0ff238a req-94bda342-7be5-47e7-bd45-f609f8dd741b tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-68b34db1-9d77-448e-a300-8cffa0ff238a req-94bda342-7be5-47e7-bd45-f609f8dd741b tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-68b34db1-9d77-448e-a300-8cffa0ff238a req-94bda342-7be5-47e7-bd45-f609f8dd741b tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:07 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.482s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Deleted volume successfully. Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09042671-4cef-448c-8e44-4f3c46244e87 tempest-VolumesExtendTest-360583250 None] Lock "cinder-ac231c6a-13bf-4462-9f89-a81ab1ebb47d-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-68b34db1-9d77-448e-a300-8cffa0ff238a req-94bda342-7be5-47e7-bd45-f609f8dd741b tempest-TestMinimumBasicScenario-283597140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c77bcc62-c8b7-40b0-ab77-855297172c45', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:12:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-68b34db1-9d77-448e-a300-8cffa0ff238a req-94bda342-7be5-47e7-bd45-f609f8dd741b tempest-TestMinimumBasicScenario-283597140 None] attachment_update completed successfully. Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Flow 'volume_create_manager' (5b282484-e650-4674-9fc9-d941dd084e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497be7ce-c749-4d3c-aa6a-bf2c14304194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497be7ce-c749-4d3c-aa6a-bf2c14304194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1738806817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992d13a5-f6c1-43e6-8660-90816986239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606ef329c88248cd83bc323a238e04ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:07Z,use_quota=True,user_id='71cf8875e5514d618af80b823db33d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7594aca8-7e7d-4c0d-846c-7d30b6627d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7594aca8-7e7d-4c0d-846c-7d30b6627d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e28c7a5-cc19-4a88-b479-af92bf028eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e28c7a5-cc19-4a88-b479-af92bf028eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992d13a5-f6c1-43e6-8660-90816986239a', 'volume_name': 'volume-992d13a5-f6c1-43e6-8660-90816986239a', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268284a4-f1f9-47a7-86cb-61f6da4b9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268284a4-f1f9-47a7-86cb-61f6da4b9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbc529b-129a-41cd-a522-9415a1ee7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Volume 992d13a5-f6c1-43e6-8660-90816986239a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992d13a5-f6c1-43e6-8660-90816986239a', 'volume_size': 1} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1738806817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992d13a5-f6c1-43e6-8660-90816986239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606ef329c88248cd83bc323a238e04ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:07Z,use_quota=True,user_id='71cf8875e5514d618af80b823db33d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Creating volume 992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:07 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a 1073741824 Nov 04 19:12:07 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:08 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a 1073741824" returned: 0 in 0.837s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:08 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:08 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (ead5d8c0-d547-46ff-ae68-d30f9abd88b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b69fea-41bb-4f8a-8bc5-941c4590b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b69fea-41bb-4f8a-8bc5-941c4590b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1949989884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22af2784-bd09-47ae-a0a0-a17eea104c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:09Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50d30a-9210-4aca-86c4-dc80a6efb492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c50d30a-9210-4aca-86c4-dc80a6efb492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c59027-615f-4d5c-a142-16c423a41100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c59027-615f-4d5c-a142-16c423a41100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22af2784-bd09-47ae-a0a0-a17eea104c6e', 'volume_name': 'volume-22af2784-bd09-47ae-a0a0-a17eea104c6e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3d5410-75db-465d-b50b-19486a444aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3d5410-75db-465d-b50b-19486a444aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae39bb-d56f-456f-96d1-7299f1c64166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Volume 22af2784-bd09-47ae-a0a0-a17eea104c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22af2784-bd09-47ae-a0a0-a17eea104c6e', 'volume_size': 1} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:08 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.486s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1949989884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22af2784-bd09-47ae-a0a0-a17eea104c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca9e25c751640739663c7fa4342f6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:09Z,use_quota=True,user_id='e738e692fc94484b838256e6ad88ccb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Creating volume 22af2784-bd09-47ae-a0a0-a17eea104c6e {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbc529b-129a-41cd-a522-9415a1ee7032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992d13a5-f6c1-43e6-8660-90816986239a', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715fde64-ffe5-4c1b-8322-37cbae9782de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:09 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e 1073741824 Nov 04 19:12:09 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Volume volume-992d13a5-f6c1-43e6-8660-90816986239a (992d13a5-f6c1-43e6-8660-90816986239a): created successfully Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (715fde64-ffe5-4c1b-8322-37cbae9782de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Flow 'volume_create_manager' (5b282484-e650-4674-9fc9-d941dd084e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-25829300-c56c-48c3-801e-72b2cf03aa47 tempest-VolumesExtendTest-360583250 None] Created volume successfully. Nov 04 19:12:09 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e 1073741824" returned: 0 in 0.616s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:09 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e Nov 04 19:12:09 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:09 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e" returned: 0 in 0.343s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae39bb-d56f-456f-96d1-7299f1c64166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22af2784-bd09-47ae-a0a0-a17eea104c6e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebaf35d9-94fd-4b55-8937-8a70fb8b4a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Volume volume-22af2784-bd09-47ae-a0a0-a17eea104c6e (22af2784-bd09-47ae-a0a0-a17eea104c6e): created successfully Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebaf35d9-94fd-4b55-8937-8a70fb8b4a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Flow 'volume_create_manager' (ead5d8c0-d547-46ff-ae68-d30f9abd88b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cb51296f-4a32-4c78-a39b-c9d78d217126 tempest-AttachVolumeTestJSON-1877871074 None] Created volume successfully. Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Creating offline snapshot 42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 of volume 992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7e5164-58e2-496b-805c-b9c23ab13bac]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:10 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:10 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:10 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.406s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:10 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 1G Nov 04 19:12:10 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 1G" returned: 0 in 0.586s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992d13a5-f6c1-43e6-8660-90816986239a -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:11 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992d13a5-f6c1-43e6-8660-90816986239a -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 Nov 04 19:12:11 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992d13a5-f6c1-43e6-8660-90816986239a -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" returned: 0 in 0.532s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 is being set with open permissions: ugo+rw Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:11 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 Nov 04 19:12:11 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=73,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" returned: 0 in 0.297s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=59,cinder:SELECT=64,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5332c139-95c7-41ea-8b43-a5bbe97809fa req-b69baaee-e48f-4456-b5f7-22af124f4e0b tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info Nov 04 19:12:12 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:12 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:12 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info is being set with open permissions: ugo+rw Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info Nov 04 19:12:12 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:12 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.info" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5332c139-95c7-41ea-8b43-a5bbe97809fa req-b69baaee-e48f-4456-b5f7-22af124f4e0b tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.792s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-5332c139-95c7-41ea-8b43-a5bbe97809fa req-b69baaee-e48f-4456-b5f7-22af124f4e0b tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-526f1a43-29af-4be4-bdfd-f1bb56cdff96 tempest-VolumesExtendTest-360583250 None] Create snapshot completed successfully Nov 04 19:12:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-5332c139-95c7-41ea-8b43-a5bbe97809fa req-b69baaee-e48f-4456-b5f7-22af124f4e0b tempest-AttachVolumeTestJSON-1877871074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-22af2784-bd09-47ae-a0a0-a17eea104c6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1ba519-1676-4dd0-98f8-f7f60c03b3fe', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:12:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-5332c139-95c7-41ea-8b43-a5bbe97809fa req-b69baaee-e48f-4456-b5f7-22af124f4e0b tempest-AttachVolumeTestJSON-1877871074 None] attachment_update completed successfully. Nov 04 19:12:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:13 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afe9450-9c0b-46b1-a3f7-fec9423e87b9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:13 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:13 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:14 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.826s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 2G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 2G" returned: 0 in 0.286s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.183s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fa05a1bc-8bad-4754-a127-d785a1979821 tempest-VolumesExtendTest-360583250 None] Extend volume completed successfully. Nov 04 19:12:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-aa4c3e40-cb55-4963-b056-401c3c920fc1 req-25d2e3e2-bdec-4a82-a153-3bc4ff5ce388 tempest-AttachVolumeTestJSON-1877871074 None] Terminate volume connection completed successfully. Nov 04 19:12:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-aa4c3e40-cb55-4963-b056-401c3c920fc1 req-25d2e3e2-bdec-4a82-a153-3bc4ff5ce388 tempest-AttachVolumeTestJSON-1877871074 None] Deleting attachment c05c1017-6016-4f8a-aa39-980e299f00b1. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-quobyte-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Deleting offline snapshot 42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 of volume 992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] snapshot_file for this snap is: volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc121e-88bd-4c43-be0c-6e0699628428]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:16 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 Nov 04 19:12:16 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:17 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" returned: 0 in 0.677s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992d13a5-f6c1-43e6-8660-90816986239a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10591d-55ac-4544-a339-d7803250a094]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:17 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-e465ff31-ad5f-49dd-8aaf-9cc3ec9899de req-987d5e8a-63c5-4d02-95cb-d0286451d70f tempest-AttachVolumeTestJSON-1877871074 None] Terminate volume connection completed successfully. Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-e465ff31-ad5f-49dd-8aaf-9cc3ec9899de req-987d5e8a-63c5-4d02-95cb-d0286451d70f tempest-AttachVolumeTestJSON-1877871074 None] Deleting attachment 1c1ba519-1676-4dd0-98f8-f7f60c03b3fe. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:12:17 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.530s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 Nov 04 19:12:17 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" returned: 0 in 0.612s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468 Nov 04 19:12:18 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a.42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" returned: 0 in 0.388s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468" released by "_delete_snapshot" :: held 2.410s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" released by "delete_snapshot" :: held 2.470s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Created reservations ['21cdfece-546e-4759-8de8-117c48072009', '2be1ed2e-b939-4263-9ae3-6503e534458a', '19768f4e-2482-47b8-aee5-9abed91edfda', '2f4734f5-b9d8-440a-b447-7676e451a6f6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Delete snapshot completed successfully. Nov 04 19:12:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-21b0fc28-253f-4762-9ee7-d84e63c4b1ff tempest-VolumesExtendTest-360583250 None] Lock "cinder-42d5a69c-7bb9-4940-af1c-5e4b5a3f7468-delete_snapshot" released by "delete_snapshot" :: held 2.732s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-992d13a5-f6c1-43e6-8660-90816986239a-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "cinder-992d13a5-f6c1-43e6-8660-90816986239a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Acquiring lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec427e4-e8e2-47d5-970b-b3fc489480de]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:19 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:19 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:20 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.603s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a Nov 04 19:12:20 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:20 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-992d13a5-f6c1-43e6-8660-90816986239a" returned: 0 in 0.295s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "cinder-quobyte-992d13a5-f6c1-43e6-8660-90816986239a" released by "delete_volume" :: held 1.012s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Created reservations ['69be02c9-2652-4561-92b4-7e2c98b5ab8b', 'a4c21c0e-6504-4857-84c6-bf0925a59c1c', 'd1d25eb3-42a5-467a-a32f-56b99b0aa3cf', '162845dc-57f7-4f12-8dfc-a767b4ca4920'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:20 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:21 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Deleted volume successfully. Nov 04 19:12:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00597fff-26a9-42ce-aff3-9457e0b685a3 tempest-VolumesExtendTest-360583250 None] Lock "cinder-992d13a5-f6c1-43e6-8660-90816986239a-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:22 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:22 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:22 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:12:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-22af2784-bd09-47ae-a0a0-a17eea104c6e-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-22af2784-bd09-47ae-a0a0-a17eea104c6e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-quobyte-22af2784-bd09-47ae-a0a0-a17eea104c6e" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-22af2784-bd09-47ae-a0a0-a17eea104c6e" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b198b62-4e5a-4b31-ab38-a4399f09d3b0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e Nov 04 19:12:23 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e" returned: 0 in 0.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e Nov 04 19:12:23 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-22af2784-bd09-47ae-a0a0-a17eea104c6e" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-22af2784-bd09-47ae-a0a0-a17eea104c6e" released by "delete_volume" :: held 0.722s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:23 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Created reservations ['baad6bae-2372-4e13-9fc9-ee27899dd3a8', '5681574b-be60-4ec9-8d14-e30247ef0c60', 'b6ed011e-435f-48a2-92ca-5e2486a76a2b', '9eee4d9a-0bd5-438a-8c2d-25f303428c9f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:24 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:24 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-521b6dd4-5427-417c-9d56-ec48caa20034-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:24 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.265s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Deleted volume successfully. Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-521b6dd4-5427-417c-9d56-ec48caa20034-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6a777847-59f2-4369-acba-a858223e6940 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-22af2784-bd09-47ae-a0a0-a17eea104c6e-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-quobyte-521b6dd4-5427-417c-9d56-ec48caa20034" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-521b6dd4-5427-417c-9d56-ec48caa20034" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[287a0931-f058-4479-9e5f-374eba4777dc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:24 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 Nov 04 19:12:24 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:24 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034 Nov 04 19:12:25 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-521b6dd4-5427-417c-9d56-ec48caa20034" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-521b6dd4-5427-417c-9d56-ec48caa20034" released by "delete_volume" :: held 0.787s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Created reservations ['0b3fd586-8bfd-4234-813f-bbc48b0d04f5', '2a0cbb51-033d-40c2-97e8-c682a865dc4d', '242f733c-5c35-4f95-a5d9-d39281c87eb3', '96db5244-fa5f-43c2-92f9-5d766e5b90aa'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:25 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "cinder-quobyte-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:25 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Deleted volume successfully. Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a566f-b9f5-4e71-b6b5-f51310cca4a2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-14e33858-5dba-469f-826c-8fbc0bfe264a tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-521b6dd4-5427-417c-9d56-ec48caa20034-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:25 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f Nov 04 19:12:25 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f Nov 04 19:12:26 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Flow 'volume_create_manager' (269b9572-85fc-4731-b6dd-06a04f67f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d2cb18-18a7-4c0d-8416-709e3f06c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d2cb18-18a7-4c0d-8416-709e3f06c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2013490110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffc3963-c251-4afd-86e8-0be1c3f98080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc0384bc3cd4bd8ab92eb29387dab17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:26Z,use_quota=True,user_id='b011219df9e84199ac70dbe746105468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c84c071-546f-46d4-bac5-c69001de1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c84c071-546f-46d4-bac5-c69001de1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289eab0b-6376-4daf-b797-260e32f30bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289eab0b-6376-4daf-b797-260e32f30bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffc3963-c251-4afd-86e8-0be1c3f98080', 'volume_name': 'volume-dffc3963-c251-4afd-86e8-0be1c3f98080', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4834d333-40aa-46a1-8eb1-82c8ac3d252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4834d333-40aa-46a1-8eb1-82c8ac3d252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f23629-4cad-4285-9123-1dbcde9664c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Volume dffc3963-c251-4afd-86e8-0be1c3f98080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffc3963-c251-4afd-86e8-0be1c3f98080', 'volume_size': 1} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2013490110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffc3963-c251-4afd-86e8-0be1c3f98080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc0384bc3cd4bd8ab92eb29387dab17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:26Z,use_quota=True,user_id='b011219df9e84199ac70dbe746105468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Creating volume dffc3963-c251-4afd-86e8-0be1c3f98080 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:26 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 1073741824 Nov 04 19:12:26 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" returned: 0 in 0.273s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-quobyte-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f" released by "delete_volume" :: held 0.795s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Created reservations ['abc33771-e607-46ef-9d85-60226e4d82df', '60131bfe-c10c-43b7-9e58-1ccd306752ef', 'f06f8985-5434-4d67-b03e-cbff612edeb5', 'a595c42d-09ee-4241-964e-d6086788050c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:26 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.302s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Deleted volume successfully. Nov 04 19:12:26 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 1073741824" returned: 0 in 0.553s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cd60ec1b-83e6-49a3-97f7-e18795e7e064 tempest-AttachVolumeTestJSON-1877871074 None] Lock "cinder-6dacc03e-e43f-4ba0-b39f-30bbfd36dd7f-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 Nov 04 19:12:27 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f23629-4cad-4285-9123-1dbcde9664c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffc3963-c251-4afd-86e8-0be1c3f98080', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da0d98-b505-43f5-91b2-75d178929bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:27 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Volume volume-dffc3963-c251-4afd-86e8-0be1c3f98080 (dffc3963-c251-4afd-86e8-0be1c3f98080): created successfully Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da0d98-b505-43f5-91b2-75d178929bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Flow 'volume_create_manager' (269b9572-85fc-4731-b6dd-06a04f67f76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e5cd964a-602c-4cb2-aed2-c308502c201d tempest-VolumesNegativeTest-1838966137 None] Created volume successfully. Nov 04 19:12:37 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:INSERT=9,cinder:SELECT=35,cinder:DELETE=2,cinder:UPDATE=46 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:37 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=43,cinder:UPDATE=45,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-36995954-d047-4fe7-af15-421c2bca96c8 tempest-GroupsTest-1536375381 None] Group tempest-Group1-851510442: creating Nov 04 19:12:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-36995954-d047-4fe7-af15-421c2bca96c8 tempest-GroupsTest-1536375381 None] Group tempest-Group1-851510442: created successfully Nov 04 19:12:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-36995954-d047-4fe7-af15-421c2bca96c8 tempest-GroupsTest-1536375381 None] Create group completed successfully. Nov 04 19:12:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8ba865a6-2b0f-42f8-a9c1-1f2c6b33319b tempest-GroupsTest-1536375381 None] Group tempest-Group2-1260693445: creating Nov 04 19:12:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8ba865a6-2b0f-42f8-a9c1-1f2c6b33319b tempest-GroupsTest-1536375381 None] Group tempest-Group2-1260693445: created successfully Nov 04 19:12:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8ba865a6-2b0f-42f8-a9c1-1f2c6b33319b tempest-GroupsTest-1536375381 None] Create group completed successfully. Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (1226a3af-d78c-471a-9bfc-514543080092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43572222-92ee-49d9-904f-666e4d552ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43572222-92ee-49d9-904f-666e4d552ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165579731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b356f46f-39a9-4cfb-b6c8-16a3f03e0ee0,host='devstack@QuobyteHD#QuobyteHD',id=84dc3fe1-f3a6-4990-9180-268355496958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:45Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(381470a0-c22a-4111-8d89-7887691cae80),volume_type_id=381470a0-c22a-4111-8d89-7887691cae80)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c342e3-59da-4ce0-90f2-2deccc6a3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c342e3-59da-4ce0-90f2-2deccc6a3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07eb45e-6d1d-4f03-8c0f-f4434bce51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07eb45e-6d1d-4f03-8c0f-f4434bce51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dc3fe1-f3a6-4990-9180-268355496958', 'volume_name': 'volume-84dc3fe1-f3a6-4990-9180-268355496958', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e37e0d-53a8-45d1-b335-e170bd4e724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e37e0d-53a8-45d1-b335-e170bd4e724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a09d7bb-cff4-4f3b-95aa-cc147b9b0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:45 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Volume 84dc3fe1-f3a6-4990-9180-268355496958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dc3fe1-f3a6-4990-9180-268355496958', 'volume_size': 1} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b356f46f-39a9-4cfb-b6c8-16a3f03e0ee0,created_at=2026-11-04T18:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-165579731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b356f46f-39a9-4cfb-b6c8-16a3f03e0ee0,host='devstack@QuobyteHD#QuobyteHD',id=84dc3fe1-f3a6-4990-9180-268355496958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:45Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(381470a0-c22a-4111-8d89-7887691cae80),volume_type_id=381470a0-c22a-4111-8d89-7887691cae80)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Creating volume 84dc3fe1-f3a6-4990-9180-268355496958 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:45 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:45 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 1073741824 Nov 04 19:12:45 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:46 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 1073741824" returned: 0 in 0.755s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:46 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 Nov 04 19:12:46 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-65c5f071-043f-46e2-9e39-be5a7f84e933 req-ebc255f7-f7c8-4a94-b37d-483be56fd1c5 tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:46 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-65c5f071-043f-46e2-9e39-be5a7f84e933 req-ebc255f7-f7c8-4a94-b37d-483be56fd1c5 tempest-TestStampPattern-731719087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.207s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a09d7bb-cff4-4f3b-95aa-cc147b9b0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dc3fe1-f3a6-4990-9180-268355496958', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc69bebc-b97a-4e53-ae76-434760f53766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-65c5f071-043f-46e2-9e39-be5a7f84e933 req-ebc255f7-f7c8-4a94-b37d-483be56fd1c5 tempest-TestStampPattern-731719087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Volume volume-84dc3fe1-f3a6-4990-9180-268355496958 (84dc3fe1-f3a6-4990-9180-268355496958): created successfully Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc69bebc-b97a-4e53-ae76-434760f53766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (1226a3af-d78c-471a-9bfc-514543080092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f73456bf-7656-4904-a08b-e994da529903 tempest-GroupsTest-1536375381 None] Created volume successfully. Nov 04 19:12:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-65c5f071-043f-46e2-9e39-be5a7f84e933 req-ebc255f7-f7c8-4a94-b37d-483be56fd1c5 tempest-TestStampPattern-731719087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-624f2200-5c50-4452-9b88-9a0497bfcb07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62623523-981f-48d0-9bd7-1fab4fd4a51b', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:12:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-65c5f071-043f-46e2-9e39-be5a7f84e933 req-ebc255f7-f7c8-4a94-b37d-483be56fd1c5 tempest-TestStampPattern-731719087 None] attachment_update completed successfully. Nov 04 19:12:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Acquiring lock "cinder-quobyte-84dc3fe1-f3a6-4990-9180-268355496958" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-84dc3fe1-f3a6-4990-9180-268355496958" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:48 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b11c218-515c-459f-8441-c1223d066e49]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:48 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 Nov 04 19:12:48 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958" returned: 0 in 0.488s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:49 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958 Nov 04 19:12:49 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-84dc3fe1-f3a6-4990-9180-268355496958" returned: 0 in 0.325s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-84dc3fe1-f3a6-4990-9180-268355496958" released by "delete_volume" :: held 0.867s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Created reservations ['2e6bd089-77f7-4164-bd9b-41ee78e41160'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:49 devstack cinder-volume[87367]: WARNING cinder.quota [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1640449569 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1640449569, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:12:49 devstack cinder-volume[87367]: WARNING cinder.quota [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1640449569 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1640449569, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Created reservations ['3f6f2b84-f1f4-43cd-9b29-2b0f41d99ebb', '9db426ab-cd5c-45c4-a157-25bf6af7ba4d', '5a175fe8-98a7-4bbe-8c62-684f07f37f0b', 'a4dabb26-f738-4ec5-b00d-7aa3d3c0e4ad'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-b766bba9-db9e-4e81-84f3-bc4e13cad0a3 req-bbde5894-70d4-4548-acd6-25b50cf3d0dc tempest-TestStampPattern-731719087 None] Terminate volume connection completed successfully. Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-b766bba9-db9e-4e81-84f3-bc4e13cad0a3 req-bbde5894-70d4-4548-acd6-25b50cf3d0dc tempest-TestStampPattern-731719087 None] Deleting attachment 62623523-981f-48d0-9bd7-1fab4fd4a51b. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:49 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:49 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Created reservations ['fd12885d-3819-4a28-a2a7-bfa67bc87a15'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:50 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.400s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-65aee526-5d4f-41b3-bbd8-8b006e5a6d77 tempest-GroupsTest-1536375381 None] Delete group completed successfully. Nov 04 19:12:50 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:50 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7e9064c5-6a39-4330-a3f3-46d85c7590f6 tempest-GroupsTest-1536375381 None] Delete group completed successfully. Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Acquiring lock "cinder-dffc3963-c251-4afd-86e8-0be1c3f98080-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "cinder-dffc3963-c251-4afd-86e8-0be1c3f98080-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Acquiring lock "cinder-quobyte-dffc3963-c251-4afd-86e8-0be1c3f98080" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "cinder-quobyte-dffc3963-c251-4afd-86e8-0be1c3f98080" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5340739f-3aee-46ba-83e5-344377f3ab16]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:51 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 Nov 04 19:12:51 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:51 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4f328f56-b02a-4369-a7b2-c46200daf219 tempest-GroupsTest-1536375381 None] Group tempest-GroupsTest-Group-1081396808: creating Nov 04 19:12:51 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080" returned: 0 in 0.660s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4f328f56-b02a-4369-a7b2-c46200daf219 tempest-GroupsTest-1536375381 None] Group tempest-GroupsTest-Group-1081396808: created successfully Nov 04 19:12:52 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080 Nov 04 19:12:52 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4f328f56-b02a-4369-a7b2-c46200daf219 tempest-GroupsTest-1536375381 None] Create group completed successfully. Nov 04 19:12:52 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dffc3963-c251-4afd-86e8-0be1c3f98080" returned: 0 in 0.371s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "cinder-quobyte-dffc3963-c251-4afd-86e8-0be1c3f98080" released by "delete_volume" :: held 1.095s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Created reservations ['187c4302-1485-47d9-9644-02062161bf9e', '82dd0b09-3b39-4ca5-9b56-f5de4ca35c66', '4faabf92-ce18-4c9c-ab79-943de0837d44', 'b79edc74-ca55-421c-99f1-ad7c1d491ad0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:52 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:52 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.266s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Deleted volume successfully. Nov 04 19:12:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-71a7e821-3e27-4067-bd76-884be02ee53f tempest-VolumesNegativeTest-1838966137 None] Lock "cinder-dffc3963-c251-4afd-86e8-0be1c3f98080-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (8b47a1e2-536b-4943-94e7-2c06dbd4f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203315e-781a-4d08-ae32-f6dc0c548b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203315e-781a-4d08-ae32-f6dc0c548b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-871187579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,host='devstack@QuobyteHD#QuobyteHD',id=bf1a28b8-40c6-45df-b42b-8c292c1cee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:54Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01f2e58-f86c-4c74-9896-52616c20ea10),volume_type_id=f01f2e58-f86c-4c74-9896-52616c20ea10)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d35cda8-e314-4f92-b476-7aa066809545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d35cda8-e314-4f92-b476-7aa066809545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e0dbd9-b407-4206-96a9-bc8e70a17111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e0dbd9-b407-4206-96a9-bc8e70a17111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1a28b8-40c6-45df-b42b-8c292c1cee84', 'volume_name': 'volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663981fe-b2e2-45eb-8033-f4c607a9f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663981fe-b2e2-45eb-8033-f4c607a9f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf3ce0-5de7-4515-8dfd-b1af4843f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Volume bf1a28b8-40c6-45df-b42b-8c292c1cee84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84', 'volume_size': 1} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,created_at=2026-11-04T18:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-871187579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,host='devstack@QuobyteHD#QuobyteHD',id=bf1a28b8-40c6-45df-b42b-8c292c1cee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:54Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01f2e58-f86c-4c74-9896-52616c20ea10),volume_type_id=f01f2e58-f86c-4c74-9896-52616c20ea10)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Creating volume bf1a28b8-40c6-45df-b42b-8c292c1cee84 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:53 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:53 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 1073741824 Nov 04 19:12:53 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-624f2200-5c50-4452-9b88-9a0497bfcb07-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "cinder-624f2200-5c50-4452-9b88-9a0497bfcb07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:54 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 1073741824" returned: 0 in 0.617s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" acquired by "delete_volume" :: waited 0.046s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:54 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 Nov 04 19:12:54 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d09be-8d22-40fb-b47d-1be7b552ac3a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 Nov 04 19:12:54 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccf3ce0-5de7-4515-8dfd-b1af4843f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fe902e-4205-4a9d-9243-79242bc4b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Volume volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 (bf1a28b8-40c6-45df-b42b-8c292c1cee84): created successfully Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fe902e-4205-4a9d-9243-79242bc4b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (8b47a1e2-536b-4943-94e7-2c06dbd4f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b7b11c65-08e4-4ec8-8154-2141277e79d1 tempest-GroupsTest-1536375381 None] Created volume successfully. Nov 04 19:12:55 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07" returned: 0 in 0.512s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07 Nov 04 19:12:55 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-624f2200-5c50-4452-9b88-9a0497bfcb07" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-624f2200-5c50-4452-9b88-9a0497bfcb07" released by "delete_volume" :: held 0.899s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Created reservations ['17ec1cf3-75ca-406b-acaf-0fa64809d6a9', '02785dbe-75da-4a6a-999c-fdc4ed21361e', '848bad20-1f8b-4b12-9c9a-c0bec4cf674e', '9c3f933d-5d1e-4940-96d4-1746957a9c09'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:12:55 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.369s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Deleted volume successfully. Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-25fdba13-acbf-45af-98c9-086fff4b459c tempest-TestStampPattern-731719087 None] Lock "cinder-624f2200-5c50-4452-9b88-9a0497bfcb07-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-82a17576-379a-4859-ac92-814e272997d0-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-82a17576-379a-4859-ac92-814e272997d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Deleting offline snapshot 82a17576-379a-4859-ac92-814e272997d0 of volume 430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] snapshot_file for this snap is: volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5bf3f-b88c-4f3d-8901-dc898c4adfb0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:56 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:12:56 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:56 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.418s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9794966-e036-497a-bf61-8b13ba5853b4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (0f970d88-4f0f-478c-b19d-1bd8657a9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6ca6e6-d525-4072-a73b-bb175abbf232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:12:56 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6ca6e6-d525-4072-a73b-bb175abbf232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401362544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,host='devstack@QuobyteHD#QuobyteHD',id=ed8324f8-995f-41cb-b688-65a8739d6dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:57Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01f2e58-f86c-4c74-9896-52616c20ea10),volume_type_id=f01f2e58-f86c-4c74-9896-52616c20ea10)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7ce1fa-1c11-4bb5-b57e-94f59232c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7ce1fa-1c11-4bb5-b57e-94f59232c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f99218-7255-4ddc-a193-a2d19d0f4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f99218-7255-4ddc-a193-a2d19d0f4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8324f8-995f-41cb-b688-65a8739d6dbb', 'volume_name': 'volume-ed8324f8-995f-41cb-b688-65a8739d6dbb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a9af2-9b52-4a3b-9fa3-5d247874fc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a9af2-9b52-4a3b-9fa3-5d247874fc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a5eff4-0552-478b-b13c-2868214782e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Volume ed8324f8-995f-41cb-b688-65a8739d6dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8324f8-995f-41cb-b688-65a8739d6dbb', 'volume_size': 1} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,created_at=2026-11-04T18:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401362544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86881d89-cb2e-4268-9dd8-4dd1303a6938,host='devstack@QuobyteHD#QuobyteHD',id=ed8324f8-995f-41cb-b688-65a8739d6dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e5203a44b47496f9bb3f66234aa78d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:57Z,use_quota=True,user_id='8ddbe0445a7841fe8b6cf4c7a445fa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f01f2e58-f86c-4c74-9896-52616c20ea10),volume_type_id=f01f2e58-f86c-4c74-9896-52616c20ea10)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Creating volume ed8324f8-995f-41cb-b688-65a8739d6dbb {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:56 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb 1073741824 Nov 04 19:12:57 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.669s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:12:57 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb 1073741824" returned: 0 in 0.515s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb Nov 04 19:12:57 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.378s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a5eff4-0552-478b-b13c-2868214782e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8324f8-995f-41cb-b688-65a8739d6dbb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea4e72-a8ee-474a-b10e-147c5e3d8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:57 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0 Nov 04 19:12:57 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Volume volume-ed8324f8-995f-41cb-b688-65a8739d6dbb (ed8324f8-995f-41cb-b688-65a8739d6dbb): created successfully Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea4e72-a8ee-474a-b10e-147c5e3d8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Flow 'volume_create_manager' (0f970d88-4f0f-478c-b19d-1bd8657a9fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1f37b92f-c7ee-44a5-bf6e-58a91ba848a1 tempest-GroupsTest-1536375381 None] Created volume successfully. Nov 04 19:12:58 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7.82a17576-379a-4859-ac92-814e272997d0" returned: 0 in 0.316s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Flow 'volume_create_manager' (50edfed7-42a7-4313-8aec-25657635d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca815c69-2492-42ce-9cdb-1d1a8c626b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-82a17576-379a-4859-ac92-814e272997d0" released by "_delete_snapshot" :: held 1.979s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" released by "delete_snapshot" :: held 2.030s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca815c69-2492-42ce-9cdb-1d1a8c626b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1332546882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3f0b0-b8de-4587-83b9-41c3173f3118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa926c0ca6b6417fa11c0cbcece7773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:58Z,use_quota=True,user_id='4ca663f4a2ce4b74b21245edda8d202e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069c2222-f564-49e4-a700-1e694143cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069c2222-f564-49e4-a700-1e694143cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fdfde-a306-4588-a2b3-bd5bf794f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fdfde-a306-4588-a2b3-bd5bf794f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd3f0b0-b8de-4587-83b9-41c3173f3118', 'volume_name': 'volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118', 'volume_size': 2}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2745df0d-41d4-4db7-b64a-b793f3600d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2745df0d-41d4-4db7-b64a-b793f3600d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e976300e-6638-404a-b218-8d01637980b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:58 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Volume 1bd3f0b0-b8de-4587-83b9-41c3173f3118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118', 'volume_size': 2} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1332546882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd3f0b0-b8de-4587-83b9-41c3173f3118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa926c0ca6b6417fa11c0cbcece7773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:58Z,use_quota=True,user_id='4ca663f4a2ce4b74b21245edda8d202e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Creating volume 1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:58 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 2147483648 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:58 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 2147483648 Nov 04 19:12:58 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Created reservations ['4de4606b-ae18-4ad9-9149-75a349939591', '477b20d1-5b24-48ad-8107-0ad3e6e02185', '55426d1e-b6db-4204-855d-f6f149519ade', '33d4e16b-9198-4416-8043-0cf080794ba7'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-83dbfbbe-bfdf-4c85-927e-a838bcf88389 tempest-GroupsTest-1536375381 None] Update group completed successfully. Nov 04 19:12:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Delete snapshot completed successfully. Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ebec3147-a06b-474f-9e30-6930e6cb6951 tempest-TestStampPattern-731719087 None] Lock "cinder-82a17576-379a-4859-ac92-814e272997d0-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:58 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 2147483648" returned: 0 in 0.538s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:58 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 Nov 04 19:12:58 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:59 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e976300e-6638-404a-b218-8d01637980b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118', 'volume_size': 2}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b17df1-8f44-4a35-8534-a9b71325a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Volume volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 (1bd3f0b0-b8de-4587-83b9-41c3173f3118): created successfully Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b17df1-8f44-4a35-8534-a9b71325a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Flow 'volume_create_manager' (50edfed7-42a7-4313-8aec-25657635d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-969df38e-039d-4c1c-8110-fab44e4e3ca5 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Created volume successfully. Nov 04 19:12:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-82463fc3-f636-44c2-9a29-caa1ce248f3f tempest-GroupsTest-1536375381 None] Update group completed successfully. Nov 04 19:13:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Creating offline snapshot d55e03ea-538a-42b2-813e-df224121ee1f of volume 1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5467e-1c89-416a-be23-540d54ab3c9d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:00 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 Nov 04 19:13:00 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:01 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118" returned: 0 in 0.677s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f 2G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:01 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f 2G Nov 04 19:13:01 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Acquiring lock "cinder-quobyte-bf1a28b8-40c6-45df-b42b-8c292c1cee84" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-bf1a28b8-40c6-45df-b42b-8c292c1cee84" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8612be-b87f-43a7-9df4-1e0e68254cc4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f 2G" returned: 0 in 0.940s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 Nov 04 19:13:02 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f Nov 04 19:13:02 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-b6b12fdd-affd-4579-9266-24833e08b0a6 req-57021188-f0b0-4043-8492-c1f5830b7652 tempest-TestMinimumBasicScenario-283597140 None] Terminate volume connection completed successfully. Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-b6b12fdd-affd-4579-9266-24833e08b0a6 req-57021188-f0b0-4043-8492-c1f5830b7652 tempest-TestMinimumBasicScenario-283597140 None] Deleting attachment c77bcc62-c8b7-40b0-ab77-855297172c45. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:13:02 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f" returned: 0 in 0.483s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f is being set with open permissions: ugo+rw Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f Nov 04 19:13:02 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84" returned: 0 in 0.744s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84 Nov 04 19:13:02 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "cinder-58bd8ef3-0a86-43b4-bebd-e48800b5275b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f" returned: 0 in 0.428s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "cinder-58bd8ef3-0a86-43b4-bebd-e48800b5275b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:03 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf1a28b8-40c6-45df-b42b-8c292c1cee84" returned: 0 in 0.438s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-bf1a28b8-40c6-45df-b42b-8c292c1cee84" released by "delete_volume" :: held 1.291s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Acquiring lock "cinder-quobyte-ed8324f8-995f-41cb-b688-65a8739d6dbb" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:03 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info Nov 04 19:13:03 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-ed8324f8-995f-41cb-b688-65a8739d6dbb" acquired by "delete_volume" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "cinder-quobyte-58bd8ef3-0a86-43b4-bebd-e48800b5275b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2038b5b-bcbf-48bf-a77c-684dc1ada773]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "cinder-quobyte-58bd8ef3-0a86-43b4-bebd-e48800b5275b" acquired by "delete_volume" :: waited 0.051s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9b81f-4b2c-49c6-8dcf-0401b540b638]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb Nov 04 19:13:03 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b Nov 04 19:13:03 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info is being set with open permissions: ugo+rw Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info Nov 04 19:13:03 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb Nov 04 19:13:03 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b" returned: 0 in 0.531s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.info" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b Nov 04 19:13:04 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.508s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e15878e6-3f74-4e90-89bf-862fc360db1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Create snapshot completed successfully Nov 04 19:13:04 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ed8324f8-995f-41cb-b688-65a8739d6dbb" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "cinder-quobyte-ed8324f8-995f-41cb-b688-65a8739d6dbb" released by "delete_volume" :: held 0.901s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:04 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-58bd8ef3-0a86-43b4-bebd-e48800b5275b" returned: 0 in 0.280s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "cinder-quobyte-58bd8ef3-0a86-43b4-bebd-e48800b5275b" released by "delete_volume" :: held 0.894s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Created reservations ['fb7a98cf-efed-4c08-82a3-414ef58ae824'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:04 devstack cinder-volume[87367]: WARNING cinder.quota [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1863140380 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1863140380, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:13:04 devstack cinder-volume[87367]: WARNING cinder.quota [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1863140380 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1863140380, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-430864c6-9e1d-43cb-a8cc-5319b3a008e7-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Created reservations ['7f6c79fd-fc44-4002-a42f-6461d7c21fea', 'eac1c33c-3f06-430d-b027-9a60f3380161', 'd256b876-b092-447f-aad6-24ef5db9ff55', '0a08adc5-cb0c-4958-944a-f62e31b57411'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Created reservations ['9feb0981-9ad3-49b9-aaaa-5f1a85ecd392', '7a559f6b-0cad-4ad1-9c27-17e724646df9', 'ee76c22d-1d8f-4f40-9538-841311839de2', '1443c4b4-16c0-476c-ad4f-be1d561b2f1a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "cinder-430864c6-9e1d-43cb-a8cc-5319b3a008e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Acquiring lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" acquired by "delete_volume" :: waited 0.039s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:04 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:04 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49d66d-39c6-4cc8-a4a1-b238bca20d7c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Created reservations ['f7896998-33a2-4781-b5cc-bc99abecb90e', '0249bc34-1910-4305-b622-26d46edf53f2', '56221a5c-034a-4127-8978-a6a171d1fc06', 'afd51523-7e5d-45f3-a132-5a01658f78a2'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:04 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:13:04 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:04 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.310s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Deleted volume successfully. Nov 04 19:13:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cc85f0e5-a170-461b-9689-ed2174cb2f9d tempest-TestMinimumBasicScenario-283597140 None] Lock "cinder-58bd8ef3-0a86-43b4-bebd-e48800b5275b-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "cinder-d55e03ea-538a-42b2-813e-df224121ee1f-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-d55e03ea-538a-42b2-813e-df224121ee1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "cinder-quobyte-d55e03ea-538a-42b2-813e-df224121ee1f" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-d55e03ea-538a-42b2-813e-df224121ee1f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Deleting offline snapshot d55e03ea-538a-42b2-813e-df224121ee1f of volume 1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] snapshot_file for this snap is: volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:05 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.315s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba16185-428e-4e8f-9a80-884b66261cea]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:05 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-157d8325-5813-4e6d-9ba7-0c69e49c6edb tempest-GroupsTest-1536375381 None] Delete group completed successfully. Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.514s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:05 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7 Nov 04 19:13:05 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:05 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f Nov 04 19:13:05 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:05 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-430864c6-9e1d-43cb-a8cc-5319b3a008e7" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "cinder-quobyte-430864c6-9e1d-43cb-a8cc-5319b3a008e7" released by "delete_volume" :: held 0.846s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Created reservations ['eb2bf47f-fe34-44a8-81b9-66847c9ef570', '67e0ccca-e904-49ce-902a-e468df9e9222', '091dabfc-c9d6-466f-8d2b-abd559998e77', '5aac55ba-764b-41b2-ba59-9ff4538e181b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:05 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f" returned: 0 in 0.410s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e290ef29-c991-49de-bc85-5b5081508b2b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:05 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:05 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:05 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 Nov 04 19:13:05 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:06 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.499s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Deleted volume successfully. Nov 04 19:13:06 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3cda9e8f-b219-4f7c-a261-cf2684132245 tempest-TestStampPattern-731719087 None] Lock "cinder-430864c6-9e1d-43cb-a8cc-5319b3a008e7-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118" returned: 0 in 0.688s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:06 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f Nov 04 19:13:06 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:06 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f" returned: 0 in 0.706s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:07 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f Nov 04 19:13:07 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:07 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118.d55e03ea-538a-42b2-813e-df224121ee1f" returned: 0 in 0.402s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-d55e03ea-538a-42b2-813e-df224121ee1f" released by "_delete_snapshot" :: held 2.360s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" released by "delete_snapshot" :: held 2.387s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:07 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Created reservations ['74ea33d5-e166-4370-9e88-ec7a51ec335e', '4b36c553-e347-4239-bf1a-88d948fcaf15', 'b80654af-6954-46bb-bc85-e06a0437485b', '913baee9-4962-4a75-be30-5c4d63506d2e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Delete snapshot completed successfully. Nov 04 19:13:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dce52f23-2312-497c-b82d-7842ced63309 tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-d55e03ea-538a-42b2-813e-df224121ee1f-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "cinder-1bd3f0b0-b8de-4587-83b9-41c3173f3118-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-1bd3f0b0-b8de-4587-83b9-41c3173f3118-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f580eee-eb0b-4ebf-82d5-2e08eece4aba]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:08 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 Nov 04 19:13:08 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:09 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118" returned: 0 in 0.489s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:09 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118 Nov 04 19:13:09 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:09 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1bd3f0b0-b8de-4587-83b9-41c3173f3118" returned: 0 in 0.329s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-quobyte-1bd3f0b0-b8de-4587-83b9-41c3173f3118" released by "delete_volume" :: held 0.965s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Created reservations ['3153eb70-0415-47cb-bc33-4db702cc0e31', 'ae38da9e-41ae-41fc-8943-877f7a679e00', '791e33c9-152a-4c13-9a12-51114e6e12c6', 'b945a171-4d15-4a6b-b503-02daef6767d3'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:09 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:09 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:10 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:10 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Deleted volume successfully. Nov 04 19:13:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880b2b20-da40-45f5-9f4d-9d82b3c79a1a tempest-VolumesSnapshotNegativeTestJSON-1000064623 None] Lock "cinder-1bd3f0b0-b8de-4587-83b9-41c3173f3118-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Flow 'volume_create_manager' (028bfd27-0804-4c8c-b83b-573c75cf9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5986bc6f-5434-4a6f-9b9e-674d3f4f09d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5986bc6f-5434-4a6f-9b9e-674d3f4f09d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1328436395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ad6339-b834-4e7a-af0a-d02b5ba6c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75385837a3c84c2f8c3bb1033a2984cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:17Z,use_quota=True,user_id='00c85e6f108743f3a2d269b9891c5c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fd49ff-ace7-4918-973c-8293b9226314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fd49ff-ace7-4918-973c-8293b9226314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef3226-42ae-48bc-8636-56edf040f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef3226-42ae-48bc-8636-56edf040f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ad6339-b834-4e7a-af0a-d02b5ba6c122', 'volume_name': 'volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd18f333-7c7d-44b7-8919-ecc88f55a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd18f333-7c7d-44b7-8919-ecc88f55a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd4c5f-1ad3-47aa-ade8-f147826bb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Volume 80ad6339-b834-4e7a-af0a-d02b5ba6c122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122', 'volume_size': 1} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1328436395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ad6339-b834-4e7a-af0a-d02b5ba6c122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75385837a3c84c2f8c3bb1033a2984cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:17Z,use_quota=True,user_id='00c85e6f108743f3a2d269b9891c5c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Creating volume 80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:17 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:17 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 1073741824 Nov 04 19:13:17 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:17 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 1073741824" returned: 0 in 0.524s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:17 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 Nov 04 19:13:17 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:18 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122" returned: 0 in 0.302s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd4c5f-1ad3-47aa-ade8-f147826bb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85760f10-2b6f-4c49-b46a-2a69608510ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Volume volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 (80ad6339-b834-4e7a-af0a-d02b5ba6c122): created successfully Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85760f10-2b6f-4c49-b46a-2a69608510ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Flow 'volume_create_manager' (028bfd27-0804-4c8c-b83b-573c75cf9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0392e400-1f1d-46e0-beb5-f06fa47c8761 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Created volume successfully. Nov 04 19:13:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Creating offline snapshot 15b999eb-cce8-477b-916c-902724d3c5a5 of volume 80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea94ba07-ebaa-46d7-81be-f23808d197a1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:19 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 Nov 04 19:13:19 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122" returned: 0 in 0.513s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:20 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 1G Nov 04 19:13:20 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 1G" returned: 0 in 0.502s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:20 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 Nov 04 19:13:20 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:21 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5" returned: 0 in 0.342s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:21 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 is being set with open permissions: ugo+rw Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:21 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 Nov 04 19:13:21 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:21 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5" returned: 0 in 0.387s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:21 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info Nov 04 19:13:21 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:21 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info" returned: 0 in 0.365s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:21 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info is being set with open permissions: ugo+rw Nov 04 19:13:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:21 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info Nov 04 19:13:21 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.info" returned: 0 in 0.333s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:22 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5616c115-5e6d-4fdc-a67f-bd54e0ccfe36 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Create snapshot completed successfully Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.383s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:22 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:13:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "cinder-15b999eb-cce8-477b-916c-902724d3c5a5-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-15b999eb-cce8-477b-916c-902724d3c5a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "cinder-quobyte-15b999eb-cce8-477b-916c-902724d3c5a5" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-15b999eb-cce8-477b-916c-902724d3c5a5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Deleting offline snapshot 15b999eb-cce8-477b-916c-902724d3c5a5 of volume 80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] snapshot_file for this snap is: volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf04896-d2a4-4025-a6e1-a57a4d16c496]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:23 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 Nov 04 19:13:23 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:23 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5" returned: 0 in 0.483s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5149f4ea-5dc8-4f5b-8186-1316056baaef]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:24 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 Nov 04 19:13:24 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:24 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122" returned: 0 in 0.548s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:24 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 Nov 04 19:13:24 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:25 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5" returned: 0 in 0.540s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:25 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5 Nov 04 19:13:25 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:25 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122.15b999eb-cce8-477b-916c-902724d3c5a5" returned: 0 in 0.323s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-15b999eb-cce8-477b-916c-902724d3c5a5" released by "_delete_snapshot" :: held 2.071s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" released by "delete_snapshot" :: held 2.107s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Created reservations ['19354d69-d3b2-4b2e-814a-18b93b2e958e', 'fc5916fd-e864-4a1d-b9e1-f01a8f806812', '78669383-e0d8-4802-9401-f31c93f31f01', '0a71f778-8399-438d-9aeb-cf849d720007'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Delete snapshot completed successfully. Nov 04 19:13:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5268d4f0-31cd-4a53-b8af-9b678ec2ffe0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-15b999eb-cce8-477b-916c-902724d3c5a5-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "cinder-80ad6339-b834-4e7a-af0a-d02b5ba6c122-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-80ad6339-b834-4e7a-af0a-d02b5ba6c122-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4066bcfa-07fe-4b19-b21b-112418df2e25]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:27 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 Nov 04 19:13:27 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:27 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122" returned: 0 in 0.584s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:27 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122 Nov 04 19:13:27 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:27 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-80ad6339-b834-4e7a-af0a-d02b5ba6c122" returned: 0 in 0.332s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-quobyte-80ad6339-b834-4e7a-af0a-d02b5ba6c122" released by "delete_volume" :: held 1.036s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Created reservations ['5d1a7708-d947-473b-be0e-2ecddae64897', '574703a0-5abf-4160-8a44-546d564f5af3', '1abfdb7c-4be0-4871-8f55-190bb7734de6', '759be127-b925-4679-a7ce-bcf46a38951f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:28 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:28 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:28 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.371s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:28 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Deleted volume successfully. Nov 04 19:13:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-faf7adf7-cf8c-4b47-88b3-97a5f7dd45a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1934607901 None] Lock "cinder-80ad6339-b834-4e7a-af0a-d02b5ba6c122-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Flow 'volume_create_manager' (06eb3d39-efdc-477e-a123-a472881b79c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a9b1cf-405c-4103-bbd3-7007dc9c9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a9b1cf-405c-4103-bbd3-7007dc9c9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c525c9dd-345c-4dc9-95ac-ed4d8a432cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b8f1d19cec4dc4ab7c9b18340acd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:30Z,use_quota=True,user_id='e00490db5edd4fd4bec891287918ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc60a28-af68-4bc8-b6b6-17d63f1bb1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc60a28-af68-4bc8-b6b6-17d63f1bb1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06648c5a-2ae8-42a8-988d-4c9e8841d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:30 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06648c5a-2ae8-42a8-988d-4c9e8841d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c525c9dd-345c-4dc9-95ac-ed4d8a432cc1', 'volume_name': 'volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1', 'volume_size': 1, 'image_id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40ce4ba67bc230f29197944d905a6760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5b8f1d19cec4dc4ab7c9b18340acd8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '233d35b681ac1eb6e070e427d39447baf9910325942111c37f5f9c77307ffbf9b70222a458de47841a64d5c2083aaad510a73c791ead9b3f3282c95c494d2058', 'id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'created_at': datetime.datetime(2026, 11, 4, 18, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/457e662a-7923-4ef1-8aeb-9ae191f6406f/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f3b045-0527-4cc9-832f-d3a5cd9fced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f3b045-0527-4cc9-832f-d3a5cd9fced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cd7089-405a-4806-8e61-4fba809fc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:31 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1', 'volume_size': 1, 'image_id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40ce4ba67bc230f29197944d905a6760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5b8f1d19cec4dc4ab7c9b18340acd8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '233d35b681ac1eb6e070e427d39447baf9910325942111c37f5f9c77307ffbf9b70222a458de47841a64d5c2083aaad510a73c791ead9b3f3282c95c494d2058', 'id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'created_at': datetime.datetime(2026, 11, 4, 18, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/457e662a-7923-4ef1-8aeb-9ae191f6406f/file', 'properties': {}}, 'image_service': } Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Trying to clone c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 from image 457e662a-7923-4ef1-8aeb-9ae191f6406f at location (None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:13:31 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[756462dd-bdf1-4732-9b33-7a1f12edbe2f]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:31 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:31 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:31 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:31 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:31 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:32 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Temporary image 457e662a-7923-4ef1-8aeb-9ae191f6406f is fetched for user e00490db5edd4fd4bec891287918ffe7. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe4a07-1f74-4a6f-aab4-738b1fa6f0b3]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:32 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:32 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:32 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:32 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:32 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:33 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c525c9dd-345c-4dc9-95ac-ed4d8a432cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b8f1d19cec4dc4ab7c9b18340acd8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:30Z,use_quota=True,user_id='e00490db5edd4fd4bec891287918ffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Creating volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:33 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:33 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1073741824 Nov 04 19:13:33 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:33 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1073741824" returned: 0 in 0.530s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:33 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 Nov 04 19:13:33 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:33 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" returned: 0 in 0.311s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Attempting download of 457e662a-7923-4ef1-8aeb-9ae191f6406f ((None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}])) to volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99576dc-5e8e-4d21-b331-e24494e7d008]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:34 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit Nov 04 19:13:34 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:34 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit" returned: 0 in 0.454s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:34 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit Nov 04 19:13:34 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:34 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit" returned: 1 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_457e662a-7923-4ef1-8aeb-9ae191f6406f_qz3bbtit' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[49235372-3f4d-4ef5-8d83-0d407d5fda29]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:35 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:35 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:35 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:35 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD Nov 04 19:13:35 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:35 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] 457e662a-7923-4ef1-8aeb-9ae191f6406f was raw, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:13:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:35 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 Nov 04 19:13:35 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:36 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" returned: 0 in 0.619s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_457e662a-7923-4ef1-8aeb-9ae191f6406f_znw8hwl2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:13:36 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:36 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1G Nov 04 19:13:36 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:36 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 1G" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Downloaded image 457e662a-7923-4ef1-8aeb-9ae191f6406f ((None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}])) to volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Temporary image 457e662a-7923-4ef1-8aeb-9ae191f6406f for user e00490db5edd4fd4bec891287918ffe7 is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Marking volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Copying metadata from image 457e662a-7923-4ef1-8aeb-9ae191f6406f to c525c9dd-345c-4dc9-95ac-ed4d8a432cc1. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Creating volume glance metadata for volume c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 backed by image 457e662a-7923-4ef1-8aeb-9ae191f6406f with: {'image_id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '40ce4ba67bc230f29197944d905a6760', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cd7089-405a-4806-8e61-4fba809fc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1', 'volume_size': 1, 'image_id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/457e662a-7923-4ef1-8aeb-9ae191f6406f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '40ce4ba67bc230f29197944d905a6760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5b8f1d19cec4dc4ab7c9b18340acd8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '233d35b681ac1eb6e070e427d39447baf9910325942111c37f5f9c77307ffbf9b70222a458de47841a64d5c2083aaad510a73c791ead9b3f3282c95c494d2058', 'id': '457e662a-7923-4ef1-8aeb-9ae191f6406f', 'created_at': datetime.datetime(2026, 11, 4, 18, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/457e662a-7923-4ef1-8aeb-9ae191f6406f/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5548e0-1c09-48d1-884b-c8ccd6354355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:36 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Volume volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 (c525c9dd-345c-4dc9-95ac-ed4d8a432cc1): created successfully Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5548e0-1c09-48d1-884b-c8ccd6354355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Flow 'volume_create_manager' (06eb3d39-efdc-477e-a123-a472881b79c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b123458b-fd46-4c09-a31d-a79c6fa01b36 tempest-VolumeImageDependencyTests-1543532515 None] Created volume successfully. Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Acquiring lock "cinder-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "cinder-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=126,cinder:SELECT=119,cinder:DELETE=5,cinder:INSERT=29 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=111,cinder:UPDATE=125,cinder:INSERT=39,cinder:DELETE=9 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Acquiring lock "cinder-quobyte-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "cinder-quobyte-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f6d830-da87-4ef9-a9ec-8fc581d509a9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:38 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 Nov 04 19:13:38 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:38 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" returned: 0 in 0.496s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:38 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1 Nov 04 19:13:38 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:39 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "cinder-quobyte-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1" released by "delete_volume" :: held 0.941s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Created reservations ['28cb537b-7b5f-45dc-a707-deda2cf8b37a', 'd49779c2-43c9-41da-8c1f-73e4d74a3c78', 'c0a588d9-5574-43fc-bf3f-bbbf7506a168', '1351b1e8-e677-4794-84bd-9865527ba053'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:39 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:13:39 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:39 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.310s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Deleted volume successfully. Nov 04 19:13:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6139de72-13e7-4565-b7cd-dc595e31bcd5 tempest-VolumeImageDependencyTests-1543532515 None] Lock "cinder-c525c9dd-345c-4dc9-95ac-ed4d8a432cc1-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Flow 'volume_create_manager' (a25caa52-f0a0-4079-9542-c3a27519a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eebdd14-acf5-48f6-a0cf-b085f24479a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eebdd14-acf5-48f6-a0cf-b085f24479a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6140eb893784ec29f9b3abc66af3959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:49Z,use_quota=True,user_id='f68abd037a704c3086bc8a4131def47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55461720-2d81-46c3-a5db-409448e4f219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55461720-2d81-46c3-a5db-409448e4f219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596d3ab5-08a0-4981-92f8-3cfa06a1f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596d3ab5-08a0-4981-92f8-3cfa06a1f006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5', 'volume_name': 'volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e109c-358c-4047-810a-dd48f6f3ea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e109c-358c-4047-810a-dd48f6f3ea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41510101-d139-4fa0-94da-3ebff298cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:48 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Volume 5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5', 'volume_size': 1} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6140eb893784ec29f9b3abc66af3959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:49Z,use_quota=True,user_id='f68abd037a704c3086bc8a4131def47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Creating volume 5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:48 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:48 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 1073741824 Nov 04 19:13:48 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:49 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 1073741824" returned: 0 in 0.543s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:49 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 Nov 04 19:13:49 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:49 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" returned: 0 in 0.334s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41510101-d139-4fa0-94da-3ebff298cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57f73cd-2512-4f9d-a51f-0c7070430370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:49 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Volume volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 (5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5): created successfully Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57f73cd-2512-4f9d-a51f-0c7070430370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:49 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Flow 'volume_create_manager' (a25caa52-f0a0-4079-9542-c3a27519a119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-500a5007-b0a7-488d-b299-9c786d965cb7 tempest-CinderUnicodeTest-1909384286 None] Created volume successfully. Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Flow 'volume_create_manager' (225f0920-3309-487c-beec-2a8cde363f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdaef9f-d803-41c7-b90a-eeb642f6a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdaef9f-d803-41c7-b90a-eeb642f6a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1289654387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759ec5e-547d-4cf3-b990-7e558e8c87b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6140eb893784ec29f9b3abc66af3959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:51Z,use_quota=True,user_id='f68abd037a704c3086bc8a4131def47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c623885-9a65-4d89-a7ef-f6f682150200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c623885-9a65-4d89-a7ef-f6f682150200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80811d97-cae0-4734-9a24-5903cfa6b7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80811d97-cae0-4734-9a24-5903cfa6b7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1759ec5e-547d-4cf3-b990-7e558e8c87b3', 'volume_name': 'volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022ffbb-d928-4c0f-b64b-f4613a3a41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022ffbb-d928-4c0f-b64b-f4613a3a41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dfc011-1fe0-4c40-ab7d-540fdf60d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Volume 1759ec5e-547d-4cf3-b990-7e558e8c87b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3', 'volume_size': 1} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1289654387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759ec5e-547d-4cf3-b990-7e558e8c87b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6140eb893784ec29f9b3abc66af3959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:51Z,use_quota=True,user_id='f68abd037a704c3086bc8a4131def47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Creating volume 1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:51 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:51 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 1073741824 Nov 04 19:13:51 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:52 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 1073741824" returned: 0 in 0.688s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:52 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 Nov 04 19:13:52 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:52 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3" returned: 0 in 0.431s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dfc011-1fe0-4c40-ab7d-540fdf60d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8944cb8a-202f-4639-a152-ee33e26d1445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:52 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Volume volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 (1759ec5e-547d-4cf3-b990-7e558e8c87b3): created successfully Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8944cb8a-202f-4639-a152-ee33e26d1445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Flow 'volume_create_manager' (225f0920-3309-487c-beec-2a8cde363f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b3068dad-e67a-434d-91e7-0f73de46fb3a tempest-CinderUnicodeTest-1909384286 None] Created volume successfully. Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (3387f074-8eb9-46e0-824e-961c6cd72134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d020b3-eba3-40c6-b5c5-57d844ea762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d020b3-eba3-40c6-b5c5-57d844ea762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1669714327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07f0463-86b2-43f8-9777-e036652d69d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:54Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c1a139-34e2-40d8-b593-03ce47c8ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c1a139-34e2-40d8-b593-03ce47c8ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa3a8a-dcce-4797-82b9-17f7477c3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa3a8a-dcce-4797-82b9-17f7477c3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07f0463-86b2-43f8-9777-e036652d69d1', 'volume_name': 'volume-e07f0463-86b2-43f8-9777-e036652d69d1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec4d2c1-496b-401f-8521-11556eb52cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec4d2c1-496b-401f-8521-11556eb52cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac20dc5e-e4b1-4b13-85a0-eb705ec14f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Volume e07f0463-86b2-43f8-9777-e036652d69d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07f0463-86b2-43f8-9777-e036652d69d1', 'volume_size': 1} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1669714327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07f0463-86b2-43f8-9777-e036652d69d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:54Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Creating volume e07f0463-86b2-43f8-9777-e036652d69d1 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:54 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:54 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 1073741824 Nov 04 19:13:54 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:54 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 1073741824" returned: 0 in 0.594s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:55 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 Nov 04 19:13:55 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:55 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1" returned: 0 in 0.378s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.945s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Creating offline snapshot 9ff3f12e-6065-45b7-bf36-68ca533f86ff of volume 1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac20dc5e-e4b1-4b13-85a0-eb705ec14f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07f0463-86b2-43f8-9777-e036652d69d1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a688b9f1-7ae7-4c5d-acf8-dfa127e1c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c93d4-273b-48af-af5b-1a8d19c8bff3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Volume volume-e07f0463-86b2-43f8-9777-e036652d69d1 (e07f0463-86b2-43f8-9777-e036652d69d1): created successfully Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a688b9f1-7ae7-4c5d-acf8-dfa127e1c238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (3387f074-8eb9-46e0-824e-961c6cd72134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-64a7dad4-7fcd-4ff1-8e99-f2d34854548b tempest-VolumesListAdminTestJSON-1517830887 None] Created volume successfully. Nov 04 19:13:55 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 Nov 04 19:13:55 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:55 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3" returned: 0 in 0.472s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:55 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff 1G Nov 04 19:13:55 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:56 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff 1G" returned: 0 in 0.599s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:56 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff Nov 04 19:13:56 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:56 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff" returned: 0 in 0.438s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:56 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff is being set with open permissions: ugo+rw Nov 04 19:13:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:56 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff Nov 04 19:13:56 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (e5f23961-6e93-49d8-a051-2cb0094df852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dc301b-1c39-4587-bc8f-e832b1744f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6dc301b-1c39-4587-bc8f-e832b1744f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1408784939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b872a-015d-471c-ab82-f872229e637f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:57Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44ad552-2e75-424d-92de-5f7c6c423a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44ad552-2e75-424d-92de-5f7c6c423a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fee1e70-f23f-4724-902b-dadad0b1f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fee1e70-f23f-4724-902b-dadad0b1f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1b872a-015d-471c-ab82-f872229e637f', 'volume_name': 'volume-cc1b872a-015d-471c-ab82-f872229e637f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac5d367-4fb7-47a4-b19a-c90032884541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac5d367-4fb7-47a4-b19a-c90032884541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce55a39-8d39-4960-b0c9-33fd3ba9a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Volume cc1b872a-015d-471c-ab82-f872229e637f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1b872a-015d-471c-ab82-f872229e637f', 'volume_size': 1} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:57 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff" returned: 0 in 0.312s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:57 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info Nov 04 19:13:57 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:57 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:57 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info is being set with open permissions: ugo+rw Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:57 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info Nov 04 19:13:57 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:57 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.info" returned: 0 in 0.329s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1408784939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b872a-015d-471c-ab82-f872229e637f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:57Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Creating volume cc1b872a-015d-471c-ab82-f872229e637f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:58 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:58 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f 1073741824 Nov 04 19:13:58 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fa55b3f6-4bc3-4601-9b44-338639d6e926 tempest-CinderUnicodeTest-1909384286 None] Create snapshot completed successfully Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-9ff3f12e-6065-45b7-bf36-68ca533f86ff-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:58 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f 1073741824" returned: 0 in 0.724s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-9ff3f12e-6065-45b7-bf36-68ca533f86ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-quobyte-9ff3f12e-6065-45b7-bf36-68ca533f86ff" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-9ff3f12e-6065-45b7-bf36-68ca533f86ff" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Deleting offline snapshot 9ff3f12e-6065-45b7-bf36-68ca533f86ff of volume 1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] snapshot_file for this snap is: volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[48254713-fa1f-4ef4-8d32-a6a5165aa26f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:58 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f Nov 04 19:13:58 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:59 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff Nov 04 19:13:59 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:59 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f" returned: 0 in 0.454s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce55a39-8d39-4960-b0c9-33fd3ba9a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1b872a-015d-471c-ab82-f872229e637f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f7ce5a-033d-4e8b-9e8a-a949f14b3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Volume volume-cc1b872a-015d-471c-ab82-f872229e637f (cc1b872a-015d-471c-ab82-f872229e637f): created successfully Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f7ce5a-033d-4e8b-9e8a-a949f14b3ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (e5f23961-6e93-49d8-a051-2cb0094df852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:59 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-744b2f15-b251-4cb3-8a7e-880fe69b9e33 tempest-VolumesListAdminTestJSON-1517830887 None] Created volume successfully. Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff" returned: 0 in 0.522s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[502933da-bd52-4d0f-bee9-10ab8e82f9fd]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:59 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 Nov 04 19:13:59 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:59 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3" returned: 0 in 0.539s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:00 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff Nov 04 19:14:00 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:00 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff" returned: 0 in 0.769s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:00 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff Nov 04 19:14:00 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:01 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3.9ff3f12e-6065-45b7-bf36-68ca533f86ff" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-9ff3f12e-6065-45b7-bf36-68ca533f86ff" released by "_delete_snapshot" :: held 2.470s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" released by "delete_snapshot" :: held 2.528s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Created reservations ['2274446b-3a4b-477f-8e1a-45955f0b32d7', '5c8564b1-1adf-456d-a447-bad1bc30149d', '65b786bc-482c-4e93-9a84-9ae4e883dd03', 'ddc5894f-2cc4-430d-acf1-4ee7693a9408'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (b9ea57c1-1d1b-4be0-8ec0-e0229161714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302cf90e-901b-4352-bce8-353fea22f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302cf90e-901b-4352-bce8-353fea22f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1022505938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f084c1-89d3-4282-af6c-f29fb1e3e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:01Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe0e08-61e3-4c1a-ac60-c04c725342b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fe0e08-61e3-4c1a-ac60-c04c725342b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f83202-1083-4135-9d1c-75ebf5d815cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f83202-1083-4135-9d1c-75ebf5d815cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f084c1-89d3-4282-af6c-f29fb1e3e814', 'volume_name': 'volume-69f084c1-89d3-4282-af6c-f29fb1e3e814', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c5f3c-7d83-402c-b969-d77eb7255e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250c5f3c-7d83-402c-b969-d77eb7255e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac86461-2123-4fb9-b689-3289c8bbdcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Volume 69f084c1-89d3-4282-af6c-f29fb1e3e814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f084c1-89d3-4282-af6c-f29fb1e3e814', 'volume_size': 1} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1022505938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f084c1-89d3-4282-af6c-f29fb1e3e814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd7f6ae49b1437b8d27346ed9a7267b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:01Z,use_quota=True,user_id='a26c2938fa664a6cb97d237a4b2b2ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Creating volume 69f084c1-89d3-4282-af6c-f29fb1e3e814 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:01 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:01 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 1073741824 Nov 04 19:14:01 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Delete snapshot completed successfully. Nov 04 19:14:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fbc5dd8a-877d-4e32-a56b-3581f85a149d tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-9ff3f12e-6065-45b7-bf36-68ca533f86ff-delete_snapshot" released by "delete_snapshot" :: held 3.114s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-1759ec5e-547d-4cf3-b990-7e558e8c87b3-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-1759ec5e-547d-4cf3-b990-7e558e8c87b3-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" acquired by "delete_volume" :: waited 0.051s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd891ec-c582-4c2d-92b8-22438a073eca]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:02 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 Nov 04 19:14:02 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:02 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 1073741824" returned: 0 in 1.061s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:02 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 Nov 04 19:14:02 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:03 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3" returned: 0 in 0.647s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:03 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3 Nov 04 19:14:03 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:03 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814" returned: 0 in 0.332s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac86461-2123-4fb9-b689-3289c8bbdcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f084c1-89d3-4282-af6c-f29fb1e3e814', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e2e26c-bd74-414f-ad05-a3123f954b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:03 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Volume volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 (69f084c1-89d3-4282-af6c-f29fb1e3e814): created successfully Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e2e26c-bd74-414f-ad05-a3123f954b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Flow 'volume_create_manager' (b9ea57c1-1d1b-4be0-8ec0-e0229161714f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8d065cb9-64c2-4fcf-a9a9-85a736c07f26 tempest-VolumesListAdminTestJSON-1517830887 None] Created volume successfully. Nov 04 19:14:03 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1759ec5e-547d-4cf3-b990-7e558e8c87b3" returned: 0 in 0.379s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-1759ec5e-547d-4cf3-b990-7e558e8c87b3" released by "delete_volume" :: held 1.189s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Created reservations ['9fe50ef0-6f32-4a0f-96c1-55f7c9afa2b4', 'eb509f3f-d051-45f3-a060-16bbbf44cc99', '477f8d84-1385-4105-bff0-99fb545e7751', 'd589816a-6d4a-4611-9cb0-34f2c6f95134'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:03 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:03 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:04 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Deleted volume successfully. Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4fb006d2-b57d-48a1-8da4-53e5763a2560 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-1759ec5e-547d-4cf3-b990-7e558e8c87b3-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "cinder-quobyte-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[079474d7-5926-4a5a-b610-2e244b78caaa]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:05 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 Nov 04 19:14:05 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:05 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" returned: 0 in 0.729s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:05 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5 Nov 04 19:14:05 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Flow 'volume_create_manager' (cbda828f-9670-4df3-92cd-ee534c53929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cd6097-7590-4f3b-8f2c-b32fdeba854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8cd6097-7590-4f3b-8f2c-b32fdeba854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb665ab-04eb-44b4-97d5-934a5078340d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c378f7c461df4b219c9fc7c71ddfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:06Z,use_quota=True,user_id='7c129d664a7345a6a204176cf73f3144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65dcca2-7978-4780-80bd-7c17848d4d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65dcca2-7978-4780-80bd-7c17848d4d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aba7dff-d3ab-41ef-a0fb-35d44c0f6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aba7dff-d3ab-41ef-a0fb-35d44c0f6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb665ab-04eb-44b4-97d5-934a5078340d', 'volume_name': 'volume-5bb665ab-04eb-44b4-97d5-934a5078340d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45319f7d-f60c-4fd5-87a3-42ce4649ef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45319f7d-f60c-4fd5-87a3-42ce4649ef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db868577-d5e2-4ad6-b542-7bb6bdf4aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Volume 5bb665ab-04eb-44b4-97d5-934a5078340d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb665ab-04eb-44b4-97d5-934a5078340d', 'volume_size': 1} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb665ab-04eb-44b4-97d5-934a5078340d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c378f7c461df4b219c9fc7c71ddfd020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:06Z,use_quota=True,user_id='7c129d664a7345a6a204176cf73f3144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Creating volume 5bb665ab-04eb-44b4-97d5-934a5078340d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:05 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:05 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d 1073741824 Nov 04 19:14:05 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:06 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" returned: 0 in 0.595s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-quobyte-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5" released by "delete_volume" :: held 1.400s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Created reservations ['929814c7-7d53-40d4-9609-d6e5f3c9b355', 'e38de763-9c92-46a6-8c75-f7cbe91660b9', '90e38141-e1c3-4313-8530-e446d4b8119c', '09f59c53-a46c-47ba-b71a-2cb0f8bab33e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:06 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:06 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:06 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d 1073741824" returned: 0 in 0.789s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:06 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d Nov 04 19:14:06 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:06 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.447s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Deleted volume successfully. Nov 04 19:14:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-149184a6-97ab-482b-b2d6-a8b1c979eb51 tempest-CinderUnicodeTest-1909384286 None] Lock "cinder-5ba5c408-0e42-4d1f-a5bc-cdae7ba6b1b5-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:07 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d" returned: 0 in 0.371s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db868577-d5e2-4ad6-b542-7bb6bdf4aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb665ab-04eb-44b4-97d5-934a5078340d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a542be-e53e-411c-849f-a089e1e72edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Volume volume-5bb665ab-04eb-44b4-97d5-934a5078340d (5bb665ab-04eb-44b4-97d5-934a5078340d): created successfully Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a542be-e53e-411c-849f-a089e1e72edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Flow 'volume_create_manager' (cbda828f-9670-4df3-92cd-ee534c53929d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b611e5c8-01f5-4974-a61c-2c07a15198a0 tempest-VolumesListAdminTestJSON-195281406 None] Created volume successfully. Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Acquiring lock "cinder-5bb665ab-04eb-44b4-97d5-934a5078340d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "cinder-5bb665ab-04eb-44b4-97d5-934a5078340d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Acquiring lock "cinder-quobyte-5bb665ab-04eb-44b4-97d5-934a5078340d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "cinder-quobyte-5bb665ab-04eb-44b4-97d5-934a5078340d" acquired by "delete_volume" :: waited 0.063s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-69f084c1-89d3-4282-af6c-f29fb1e3e814-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b9ae47-be26-481f-a358-8a09a3f12745]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-69f084c1-89d3-4282-af6c-f29fb1e3e814-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Flow 'volume_create_manager' (6b078c65-466b-4233-8dc4-f8beb2df9b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dc3f6-4e1b-412a-bb41-e7c1431f1750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:08 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d Nov 04 19:14:08 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dc3f6-4e1b-412a-bb41-e7c1431f1750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-241930886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763b9992-cbf7-4c6c-82f8-d78d3ca803b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a5d440aa6c44a191ea1d1c11506c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:08Z,use_quota=True,user_id='0242acfa347a4556bdc0eadddc19406b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd4a97f-6742-4d41-9227-c5124f57a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd4a97f-6742-4d41-9227-c5124f57a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935a38b-2ee0-4a17-ac73-0d7abaae7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-quobyte-69f084c1-89d3-4282-af6c-f29fb1e3e814" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-69f084c1-89d3-4282-af6c-f29fb1e3e814" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f658c-4daf-46c2-b4aa-2c95ae983cfc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:08 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d" returned: 0 in 0.595s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:08 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d Nov 04 19:14:08 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:08 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 Nov 04 19:14:08 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935a38b-2ee0-4a17-ac73-0d7abaae7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'volume_name': 'volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a342cd-d2aa-4ccb-a774-b46e65e1fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a342cd-d2aa-4ccb-a774-b46e65e1fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09018c38-dbad-45f4-9350-2ad2395f1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Trying to clone 763b9992-cbf7-4c6c-82f8-d78d3ca803b6 from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:14:09 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bb665ab-04eb-44b4-97d5-934a5078340d" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "cinder-quobyte-5bb665ab-04eb-44b4-97d5-934a5078340d" released by "delete_volume" :: held 1.089s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:09 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814" returned: 0 in 0.840s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:09 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814 Nov 04 19:14:09 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Created reservations ['ab9d7229-251b-49ef-876d-206ed7c87bf6', 'ecc8096d-e6af-41b5-9d67-8ec250015b79', '9ac81a4a-9a4f-40ae-b7bf-8e0b7ba7a109', '6857ed1d-eda6-4c50-b5a5-6c13d780e97c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:09 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:09 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:09 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-69f084c1-89d3-4282-af6c-f29fb1e3e814" returned: 0 in 0.456s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-69f084c1-89d3-4282-af6c-f29fb1e3e814" released by "delete_volume" :: held 1.404s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:09 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:14:09 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Created reservations ['a9aa4333-470f-438a-a687-04c7ec6df5da', '8cf43e04-b9e8-40db-85d6-b5c7149fa321', 'db457623-0565-4866-b9e1-ca42b2952629', 'f51ce399-7388-4994-8227-b776dd976dde'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:10 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.409s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6a90c6-6ee1-4aba-ad78-d10c20fcde5f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Deleted volume successfully. Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0dfbc792-6f04-4bd9-b9f0-bd93d0d568ce tempest-VolumesListAdminTestJSON-195281406 None] Lock "cinder-5bb665ab-04eb-44b4-97d5-934a5078340d-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:10 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:10 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:10 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD Nov 04 19:14:10 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:10 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.314s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Deleted volume successfully. Nov 04 19:14:10 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-30886c56-7be7-4bab-a16f-c95b4a479404 tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-69f084c1-89d3-4282-af6c-f29fb1e3e814-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 is fetched for user 0242acfa347a4556bdc0eadddc19406b. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856448d-0d95-4212-8ca1-aa3d2e74e166]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-cc1b872a-015d-471c-ab82-f872229e637f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-cc1b872a-015d-471c-ab82-f872229e637f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-quobyte-cc1b872a-015d-471c-ab82-f872229e637f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:10 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD Nov 04 19:14:10 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-cc1b872a-015d-471c-ab82-f872229e637f" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b12210-dcbd-471a-abe0-6bd25241d0d1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:10 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f Nov 04 19:14:10 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:11 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-241930886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763b9992-cbf7-4c6c-82f8-d78d3ca803b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a5d440aa6c44a191ea1d1c11506c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:08Z,use_quota=True,user_id='0242acfa347a4556bdc0eadddc19406b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Creating volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:11 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:11 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1073741824 Nov 04 19:14:11 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:11 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f" returned: 0 in 0.416s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:11 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f Nov 04 19:14:11 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:11 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1073741824" returned: 0 in 0.511s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:11 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cc1b872a-015d-471c-ab82-f872229e637f" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-cc1b872a-015d-471c-ab82-f872229e637f" released by "delete_volume" :: held 0.771s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:11 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 Nov 04 19:14:11 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Created reservations ['3d2bd4c7-bc54-4940-bc31-f72226ed0c1a', 'b1d38da6-ed69-473f-8ce5-c5a70095ee0a', 'ebf9286f-69fe-493c-bf06-11ec0d95fde4', '87c17ece-40e6-4898-9eaf-e0878162fc59'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:11 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:11 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:11 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" returned: 0 in 0.316s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:11 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Attempting download of 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:14:12 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-e07f0463-86b2-43f8-9777-e036652d69d1-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.290s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Deleted volume successfully. Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-e07f0463-86b2-43f8-9777-e036652d69d1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c46fb-1b2f-42bf-aac9-c3185133d28d]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-80b85ebf-8c55-4bcf-a698-a7991a0399fd tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-cc1b872a-015d-471c-ab82-f872229e637f-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "cinder-quobyte-e07f0463-86b2-43f8-9777-e036652d69d1" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-e07f0463-86b2-43f8-9777-e036652d69d1" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de6211a-98fd-419f-b603-87b7bfc94bf7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:12 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv Nov 04 19:14:12 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:12 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 Nov 04 19:14:12 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:12 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv" returned: 0 in 0.368s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:12 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv Nov 04 19:14:12 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:12 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1" returned: 0 in 0.399s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:12 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1 Nov 04 19:14:12 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:12 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv" returned: 1 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ddc0397-cfae-4b65-9580-9560490b2ca6_a0js5eqv' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b7f58-5b1a-4040-ab14-35fd4a4e3d71]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:12 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e07f0463-86b2-43f8-9777-e036652d69d1" returned: 0 in 0.297s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-quobyte-e07f0463-86b2-43f8-9777-e036652d69d1" released by "delete_volume" :: held 0.749s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:12 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD Nov 04 19:14:12 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:12 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Created reservations ['369f46d3-942a-4038-ad31-287ce5cb7739', 'fd3feba4-95a3-4dc7-b486-3c81e309c45f', '73996f33-6b57-406c-a261-6b1409924896', '3ffbad54-94de-4591-8f84-dd1ca4ae0c10'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:13 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:13 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:13 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] 4ddc0397-cfae-4b65-9580-9560490b2ca6 was qcow2, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:13 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 Nov 04 19:14:13 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:13 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Deleted volume successfully. Nov 04 19:14:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6c5a118-e5cd-46db-b131-765abe79dffa tempest-VolumesListAdminTestJSON-1517830887 None] Lock "cinder-e07f0463-86b2-43f8-9777-e036652d69d1-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:15 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" returned: 0 in 2.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:15 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ddc0397-cfae-4b65-9580-9560490b2ca6_hgw1hov6devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:14:15 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Converted 112.00 MB image at 46.06 MB/s Nov 04 19:14:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:15 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1G Nov 04 19:14:15 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:15 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 1G" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Downloaded image 4ddc0397-cfae-4b65-9580-9560490b2ca6 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}])) to volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Temporary image 4ddc0397-cfae-4b65-9580-9560490b2ca6 for user 0242acfa347a4556bdc0eadddc19406b is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Marking volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Copying metadata from image 4ddc0397-cfae-4b65-9580-9560490b2ca6 to 763b9992-cbf7-4c6c-82f8-d78d3ca803b6. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Creating volume glance metadata for volume 763b9992-cbf7-4c6c-82f8-d78d3ca803b6 backed by image 4ddc0397-cfae-4b65-9580-9560490b2ca6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09018c38-dbad-45f4-9350-2ad2395f1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'volume_size': 1, 'image_id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ddc0397-cfae-4b65-9580-9560490b2ca6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '78aa9f3a55d445b8ba9aa70c7a23dfa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ddc0397-cfae-4b65-9580-9560490b2ca6', 'created_at': datetime.datetime(2026, 11, 4, 17, 54, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 54, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ddc0397-cfae-4b65-9580-9560490b2ca6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f94635-985c-4faf-907a-e8b82f7132ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:16 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Volume volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 (763b9992-cbf7-4c6c-82f8-d78d3ca803b6): created successfully Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f94635-985c-4faf-907a-e8b82f7132ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Flow 'volume_create_manager' (6b078c65-466b-4233-8dc4-f8beb2df9b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1d7f1597-720f-492e-a49e-1da0c67587e2 tempest-TestShelveInstance-2065277326 None] Created volume successfully. Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ab83d681-6a41-422c-83d0-2a94d74d6f3d req-ec3649b6-e1b0-46cf-a085-f349995e322f tempest-TestShelveInstance-2065277326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ab83d681-6a41-422c-83d0-2a94d74d6f3d req-ec3649b6-e1b0-46cf-a085-f349995e322f tempest-TestShelveInstance-2065277326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (08f69004-cfab-450d-a522-c4eb0e5f4eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230548c-0c10-4d33-a719-794b32f05a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230548c-0c10-4d33-a719-794b32f05a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1491583679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ed65c5-eee7-4502-aea3-e17e51542e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaca68ae5c34c29ac9999fa915b7310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:19Z,use_quota=True,user_id='bee4175c6fc44d4a99db9b55c4f5ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88e9ac9-612b-4bf5-8337-eb93cd5acc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88e9ac9-612b-4bf5-8337-eb93cd5acc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dfdaf5-7fc7-49cc-8102-cfd553d8cc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dfdaf5-7fc7-49cc-8102-cfd553d8cc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ed65c5-eee7-4502-aea3-e17e51542e03', 'volume_name': 'volume-12ed65c5-eee7-4502-aea3-e17e51542e03', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b934859-723a-4fc5-896f-60e6a177fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b934859-723a-4fc5-896f-60e6a177fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1662ded2-063b-471d-9eba-c39fd42dd885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Volume 12ed65c5-eee7-4502-aea3-e17e51542e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ed65c5-eee7-4502-aea3-e17e51542e03', 'volume_size': 1} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-ab83d681-6a41-422c-83d0-2a94d74d6f3d req-ec3649b6-e1b0-46cf-a085-f349995e322f tempest-TestShelveInstance-2065277326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1491583679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ed65c5-eee7-4502-aea3-e17e51542e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaca68ae5c34c29ac9999fa915b7310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:19Z,use_quota=True,user_id='bee4175c6fc44d4a99db9b55c4f5ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Creating volume 12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:19 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:19 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 1073741824 Nov 04 19:14:19 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-ab83d681-6a41-422c-83d0-2a94d74d6f3d req-ec3649b6-e1b0-46cf-a085-f349995e322f tempest-TestShelveInstance-2065277326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db278732-3c42-4e8a-8393-c220c3254751', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:14:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-ab83d681-6a41-422c-83d0-2a94d74d6f3d req-ec3649b6-e1b0-46cf-a085-f349995e322f tempest-TestShelveInstance-2065277326 None] attachment_update completed successfully. Nov 04 19:14:20 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 1073741824" returned: 0 in 0.610s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:20 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:20 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:20 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.265s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1662ded2-063b-471d-9eba-c39fd42dd885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ed65c5-eee7-4502-aea3-e17e51542e03', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a954cef-0785-4e65-89d9-0a288bb22541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Volume volume-12ed65c5-eee7-4502-aea3-e17e51542e03 (12ed65c5-eee7-4502-aea3-e17e51542e03): created successfully Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a954cef-0785-4e65-89d9-0a288bb22541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (08f69004-cfab-450d-a522-c4eb0e5f4eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a7b8a0c9-37c0-4886-ac1c-7068dafc3c11 tempest-VolumesDeleteCascade-1178839862 None] Created volume successfully. Nov 04 19:14:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Creating offline snapshot 1ebeb2c6-b31e-4ebb-9add-7976b573d93c of volume 12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:14:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f029a47c-952e-4924-a126-27ce98a77574]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:21 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:21 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:22 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:22 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.627s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:22 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c 1G Nov 04 19:14:22 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:14:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:14:23 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c 1G" returned: 0 in 0.827s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:23 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:23 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:23 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:23 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c is being set with open permissions: ugo+rw Nov 04 19:14:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:23 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:23 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:24 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.321s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:24 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info Nov 04 19:14:24 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:24 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info" returned: 0 in 0.557s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:24 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info is being set with open permissions: ugo+rw Nov 04 19:14:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:24 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info Nov 04 19:14:24 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:25 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.info" returned: 0 in 0.341s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.216s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-aa4b0e1a-7975-4402-968d-20e9f2d75e87 tempest-VolumesDeleteCascade-1178839862 None] Create snapshot completed successfully Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Creating offline snapshot 7c79fc8c-9aa4-4940-81ee-365419e90420 of volume 12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079fae3-8bf8-4884-b2d9-f22a7574962f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:26 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:26 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:26 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.523s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ed65c5-eee7-4502-aea3-e17e51542e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:26 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 1G Nov 04 19:14:26 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Flow 'volume_create_manager' (e97e6ad5-f14a-4f26-bd78-7eccab36e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7141731-0fb0-4ff5-aa58-2dbc696cf979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7141731-0fb0-4ff5-aa58-2dbc696cf979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1906720439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b7b4a-aa45-48a8-b06e-91854276bd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0b70db40345a09f681138af89dbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:27Z,use_quota=True,user_id='73ada71dc4b84dbab28e22b81f8bb005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5128b-483c-4ff5-8400-20074a4cbfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5128b-483c-4ff5-8400-20074a4cbfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a8e764-ee15-4426-9b7e-c911ecaa3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a8e764-ee15-4426-9b7e-c911ecaa3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c8b7b4a-aa45-48a8-b06e-91854276bd40', 'volume_name': 'volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff3a979-a548-410d-82a8-73916c0295dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff3a979-a548-410d-82a8-73916c0295dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29636fd-a5e0-41bf-b41b-2d8360e5a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:27 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Volume 9c8b7b4a-aa45-48a8-b06e-91854276bd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40', 'volume_size': 1} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:27 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 1G" returned: 0 in 0.819s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:27 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:27 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:28 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.363s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:28 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 is being set with open permissions: ugo+rw Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:28 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:28 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:28 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1906720439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b7b4a-aa45-48a8-b06e-91854276bd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0b70db40345a09f681138af89dbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:27Z,use_quota=True,user_id='73ada71dc4b84dbab28e22b81f8bb005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Creating volume 9c8b7b4a-aa45-48a8-b06e-91854276bd40 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:28 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:28 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 1073741824 Nov 04 19:14:28 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:28 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a246c996-009f-4f9f-a6ab-699db98efabc tempest-VolumesDeleteCascade-1178839862 None] Create snapshot completed successfully Nov 04 19:14:29 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 1073741824" returned: 0 in 0.640s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:29 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 Nov 04 19:14:29 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:29 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40" returned: 0 in 0.349s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29636fd-a5e0-41bf-b41b-2d8360e5a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b387c6-ce4a-4fbf-ad3a-0a604764198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Volume volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 (9c8b7b4a-aa45-48a8-b06e-91854276bd40): created successfully Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b387c6-ce4a-4fbf-ad3a-0a604764198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Flow 'volume_create_manager' (e97e6ad5-f14a-4f26-bd78-7eccab36e57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e18621d0-5519-4306-b7f5-998c0b3f5ea1 tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Created volume successfully. Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-12ed65c5-eee7-4502-aea3-e17e51542e03-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-12ed65c5-eee7-4502-aea3-e17e51542e03-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Performing cascade delete. {{(pid=87367) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-1ebeb2c6-b31e-4ebb-9add-7976b573d93c-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-1ebeb2c6-b31e-4ebb-9add-7976b573d93c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-1ebeb2c6-b31e-4ebb-9add-7976b573d93c" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-1ebeb2c6-b31e-4ebb-9add-7976b573d93c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Deleting offline snapshot 1ebeb2c6-b31e-4ebb-9add-7976b573d93c of volume 12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:14:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] snapshot_file for this snap is: volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[517fea8e-0d90-4629-ac53-c5cd04af1dda]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:30 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:30 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:30 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.436s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ed65c5-eee7-4502-aea3-e17e51542e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c6e5ae-706e-4204-993b-6bd725f73a5e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:30 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:30 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:30 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.381s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232f637-cd25-44c1-a74e-bc20c3a54833]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:31 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:31 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:31 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.460s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ed65c5-eee7-4502-aea3-e17e51542e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9371d9d-e80a-4dab-9399-5455df8ca57f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:31 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:31 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-612801b5-f8a1-4cff-9170-389d1733eb40 req-97662b2f-fd85-4d44-aec3-ee68fd6126bc tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-612801b5-f8a1-4cff-9170-389d1733eb40 req-97662b2f-fd85-4d44-aec3-ee68fd6126bc tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-612801b5-f8a1-4cff-9170-389d1733eb40 req-97662b2f-fd85-4d44-aec3-ee68fd6126bc tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-612801b5-f8a1-4cff-9170-389d1733eb40 req-97662b2f-fd85-4d44-aec3-ee68fd6126bc tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f26d0b9a-d9b2-4dda-8c01-91691701f328', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:14:31 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-612801b5-f8a1-4cff-9170-389d1733eb40 req-97662b2f-fd85-4d44-aec3-ee68fd6126bc tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] attachment_update completed successfully. Nov 04 19:14:31 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.418s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ed65c5-eee7-4502-aea3-e17e51542e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04775f3-df04-47cf-9e03-2cfa65d5c41d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:31 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:31 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:32 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.436s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:32 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:32 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:32 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:32 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c Nov 04 19:14:32 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:32 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.1ebeb2c6-b31e-4ebb-9add-7976b573d93c" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 -F qcow2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:32 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 -F qcow2 Nov 04 19:14:32 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:33 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ed65c5-eee7-4502-aea3-e17e51542e03 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 -F qcow2" returned: 0 in 0.317s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-1ebeb2c6-b31e-4ebb-9add-7976b573d93c" released by "_delete_snapshot" :: held 3.296s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" released by "delete_snapshot" :: held 3.324s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['7f8bbe20-38e9-4ec6-bc91-253095bf593f', 'de81d385-75c5-4551-8e65-269e47482a8d', '38606847-abee-4dc1-8ae7-ba3e3f977079', 'c496d26b-57df-4ef2-9e16-2392a2838577'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Delete snapshot completed successfully. Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-1ebeb2c6-b31e-4ebb-9add-7976b573d93c-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-7c79fc8c-9aa4-4940-81ee-365419e90420-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-7c79fc8c-9aa4-4940-81ee-365419e90420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-7c79fc8c-9aa4-4940-81ee-365419e90420" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-7c79fc8c-9aa4-4940-81ee-365419e90420" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Deleting offline snapshot 7c79fc8c-9aa4-4940-81ee-365419e90420 of volume 12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] snapshot_file for this snap is: volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7f5493-f004-47a2-bc72-6f9a60e2f403]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:33 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:33 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:34 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ed65c5-eee7-4502-aea3-e17e51542e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548ab4f-b56e-41bc-9101-571877c88702]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:34 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:34 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:34 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-c4c81a4d-60ae-43a5-9df9-3847cefbc6e0 req-d8e1147b-7a4a-4b58-8500-f848c6abb0aa tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Terminate volume connection completed successfully. Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-c4c81a4d-60ae-43a5-9df9-3847cefbc6e0 req-d8e1147b-7a4a-4b58-8500-f848c6abb0aa tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Deleting attachment f26d0b9a-d9b2-4dda-8c01-91691701f328. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:14:34 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.414s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:34 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:34 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:34 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.320s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:34 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420 Nov 04 19:14:34 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "cinder-9c8b7b4a-aa45-48a8-b06e-91854276bd40-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03.7c79fc8c-9aa4-4940-81ee-365419e90420" returned: 0 in 0.314s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-7c79fc8c-9aa4-4940-81ee-365419e90420" released by "_delete_snapshot" :: held 1.661s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "cinder-9c8b7b4a-aa45-48a8-b06e-91854276bd40-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" released by "delete_snapshot" :: held 1.701s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "cinder-quobyte-9c8b7b4a-aa45-48a8-b06e-91854276bd40" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "cinder-quobyte-9c8b7b4a-aa45-48a8-b06e-91854276bd40" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5679086-cd4b-45dd-8cd4-d3c4867eb731]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['db7e5395-ab65-4f96-a9c2-24aa033790c9', '4264babd-d03c-49ba-86ef-ee212749e47b', '0cadda84-275b-4c66-a37b-c07e618744fb', '51221bd6-92ae-4e87-9400-8b45f54f7f09'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:35 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Delete snapshot completed successfully. Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-7c79fc8c-9aa4-4940-81ee-365419e90420-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Snapshots deleted, issuing volume delete {{(pid=87367) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:35 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 Nov 04 19:14:35 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f821bc6-ac94-463c-be1c-aa24ae99384d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:35 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40 Nov 04 19:14:35 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03 Nov 04 19:14:35 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9c8b7b4a-aa45-48a8-b06e-91854276bd40" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "cinder-quobyte-9c8b7b4a-aa45-48a8-b06e-91854276bd40" released by "delete_volume" :: held 0.747s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Created reservations ['4c1ca381-5110-4d3c-b8cd-0bc8a7e1a904', '5321eb64-192f-486a-acb3-5ede9e0489c3', 'c807eded-1a75-4464-8c2c-25b34211d6a9', '3f148079-dd73-4d0a-bebb-967597a27d38'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:36 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12ed65c5-eee7-4502-aea3-e17e51542e03" returned: 0 in 0.266s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-12ed65c5-eee7-4502-aea3-e17e51542e03" released by "delete_volume" :: held 0.724s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:36 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:36 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['f7f45231-81a5-46f0-9b4a-2498afa7b0bc', '2264da59-78d5-415f-9a5d-fba356e7024f', '2d7390a0-2ff1-4d1b-b281-21ed50d2a50e', '50b35ae6-0fe7-4986-8463-72f9bd7324fe'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:36 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:36 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:36 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.455s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Deleted volume successfully. Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6b11adae-6ba9-4aee-9042-f3a287d1f8ed tempest-TestServerVolumeAttachScenarioOldVersion-1776717699 None] Lock "cinder-9c8b7b4a-aa45-48a8-b06e-91854276bd40-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:36 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.382s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Deleted volume successfully. Nov 04 19:14:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-27e3a490-ab67-44fb-8dc0-5a34514ceda5 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-12ed65c5-eee7-4502-aea3-e17e51542e03-delete_volume" released by "delete_volume" :: held 7.041s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=110,cinder:INSERT=38,cinder:UPDATE=125,cinder:DELETE=7 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=111,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=14 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (5be69fb4-176b-4ea7-9f8f-23e7ea922708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3d48a-b718-47fb-b4f1-16665fb1dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3d48a-b718-47fb-b4f1-16665fb1dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-392116745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645d7087-ba80-43bb-a855-fc9feb2b29dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaca68ae5c34c29ac9999fa915b7310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:38Z,use_quota=True,user_id='bee4175c6fc44d4a99db9b55c4f5ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64c0db8-f1e9-4008-ab9c-8a5d59ab89f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64c0db8-f1e9-4008-ab9c-8a5d59ab89f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1884e94a-3e5d-45c9-adb1-448b9060f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1884e94a-3e5d-45c9-adb1-448b9060f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645d7087-ba80-43bb-a855-fc9feb2b29dd', 'volume_name': 'volume-645d7087-ba80-43bb-a855-fc9feb2b29dd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74a460e-c853-4bec-b08c-1163f01010c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74a460e-c853-4bec-b08c-1163f01010c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dfd59d-11c0-4b9a-8a07-a4b675b99c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:38 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Volume 645d7087-ba80-43bb-a855-fc9feb2b29dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645d7087-ba80-43bb-a855-fc9feb2b29dd', 'volume_size': 1} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-392116745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645d7087-ba80-43bb-a855-fc9feb2b29dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaca68ae5c34c29ac9999fa915b7310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:38Z,use_quota=True,user_id='bee4175c6fc44d4a99db9b55c4f5ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Creating volume 645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:38 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:14:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:38 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd 1073741824 Nov 04 19:14:38 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:39 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd 1073741824" returned: 0 in 0.595s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:39 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:39 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:39 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.368s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dfd59d-11c0-4b9a-8a07-a4b675b99c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645d7087-ba80-43bb-a855-fc9feb2b29dd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbb803e-d89e-4146-b93c-a26e4d9e03ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Volume volume-645d7087-ba80-43bb-a855-fc9feb2b29dd (645d7087-ba80-43bb-a855-fc9feb2b29dd): created successfully Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbb803e-d89e-4146-b93c-a26e4d9e03ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (5be69fb4-176b-4ea7-9f8f-23e7ea922708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-47fe93a5-c43d-4c12-b6bc-4f866d8bc3a7 tempest-VolumesDeleteCascade-1178839862 None] Created volume successfully. Nov 04 19:14:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Creating offline snapshot 2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d of volume 645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:14:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c95eb8-990b-45cf-8b89-34777a5385f0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:40 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:40 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:41 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.475s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:41 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d 1G Nov 04 19:14:41 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:41 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d 1G" returned: 0 in 0.589s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d7087-ba80-43bb-a855-fc9feb2b29dd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:41 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d7087-ba80-43bb-a855-fc9feb2b29dd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:41 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:42 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d7087-ba80-43bb-a855-fc9feb2b29dd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.341s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:42 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d is being set with open permissions: ugo+rw Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:42 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:42 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:42 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:42 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info Nov 04 19:14:42 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:42 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info" returned: 0 in 0.270s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:42 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info is being set with open permissions: ugo+rw Nov 04 19:14:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:42 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info Nov 04 19:14:42 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:43 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.info" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9503fd84-8676-4819-a116-ea0f6f1837e2 tempest-VolumesDeleteCascade-1178839862 None] Create snapshot completed successfully Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (cc2769f8-1a39-4fad-bd51-25c1079eeac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa7f7c1-74d4-4b40-aa85-d8db59bc3d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa7f7c1-74d4-4b40-aa85-d8db59bc3d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1599636660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc3753d-d708-41c7-b97b-73df8b566212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeaca68ae5c34c29ac9999fa915b7310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:44Z,use_quota=True,user_id='bee4175c6fc44d4a99db9b55c4f5ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0231f69e-e945-4341-a5ed-30cbfe21dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0231f69e-e945-4341-a5ed-30cbfe21dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce79569-fa45-43e9-9e3e-abb3f2660e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce79569-fa45-43e9-9e3e-abb3f2660e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fc3753d-d708-41c7-b97b-73df8b566212', 'volume_name': 'volume-6fc3753d-d708-41c7-b97b-73df8b566212', 'volume_size': 1, 'snapshot_id': '2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d9b7a-4521-4f37-9e96-1b99e5af9c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45d9b7a-4521-4f37-9e96-1b99e5af9c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de371a91-712d-400a-9a8b-7ba509317a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Volume 6fc3753d-d708-41c7-b97b-73df8b566212: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fc3753d-d708-41c7-b97b-73df8b566212', 'volume_size': 1, 'snapshot_id': '2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d'} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-6fc3753d-d708-41c7-b97b-73df8b566212" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-6fc3753d-d708-41c7-b97b-73df8b566212" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Creating volume 6fc3753d-d708-41c7-b97b-73df8b566212 from snapshot 2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] snapshot: 2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d, volume: 6fc3753d-d708-41c7-b97b-73df8b566212, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e407e-5bd6-486d-9b95-61248ae1d663]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:44 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:44 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:45 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.407s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645d7087-ba80-43bb-a855-fc9feb2b29dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcef524-c070-4493-b6ca-eefd7f4403c0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:45 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:45 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:45 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.406s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:14:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:45 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 Nov 04 19:14:45 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:54 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212" returned: 0 in 8.874s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:14:54 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Converted 1024.00 MB image at 115.35 MB/s Nov 04 19:14:54 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 is being set with open permissions: ugo+rw Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:54 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 Nov 04 19:14:54 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:54 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212" returned: 0 in 0.410s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" released by "_copy_volume_from_snapshot" :: held 10.218s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-6fc3753d-d708-41c7-b97b-73df8b566212" released by "_create_volume_from_snapshot" :: held 10.298s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.314s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de371a91-712d-400a-9a8b-7ba509317a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc3753d-d708-41c7-b97b-73df8b566212', 'volume_size': 1, 'snapshot_id': '2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d427a8-ded3-4ef4-9a25-9ff7f672b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Volume volume-6fc3753d-d708-41c7-b97b-73df8b566212 (6fc3753d-d708-41c7-b97b-73df8b566212): created successfully Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d427a8-ded3-4ef4-9a25-9ff7f672b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Flow 'volume_create_manager' (cc2769f8-1a39-4fad-bd51-25c1079eeac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f99a9dda-2a30-4361-8888-c2a209926a91 tempest-VolumesDeleteCascade-1178839862 None] Created volume successfully. Nov 04 19:14:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-f318888d-fdc9-4d83-a39e-de5d9c7d894c req-7b447280-9a7e-4e6f-81c2-90738a9a4b39 tempest-TestShelveInstance-2065277326 None] Terminate volume connection completed successfully. Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-f318888d-fdc9-4d83-a39e-de5d9c7d894c req-7b447280-9a7e-4e6f-81c2-90738a9a4b39 tempest-TestShelveInstance-2065277326 None] Deleting attachment db278732-3c42-4e8a-8393-c220c3254751. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-645d7087-ba80-43bb-a855-fc9feb2b29dd-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-645d7087-ba80-43bb-a855-fc9feb2b29dd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Performing cascade delete. {{(pid=87367) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Deleting offline snapshot 2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d of volume 645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:14:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] snapshot_file for this snap is: volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a1053-3343-4f61-8fb6-65e7402927c0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:56 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:56 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:56 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.452s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645d7087-ba80-43bb-a855-fc9feb2b29dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f9885b-3adb-4bad-84be-aa89252cae78]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:56 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:56 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:57 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.548s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:57 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:57 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:57 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.448s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:57 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d Nov 04 19:14:57 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:57 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd.2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" returned: 0 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d" released by "_delete_snapshot" :: held 1.914s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" released by "delete_snapshot" :: held 1.941s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['535da72f-ccec-498c-8817-311e3cda0823', '1f350513-a395-4645-b0cd-f921f5c0d7c0', '217e7a87-a5da-4634-add1-33b7682ec117', 'c3c17668-0dbb-47e5-90ba-f5f13e5a8800'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Delete snapshot completed successfully. Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-2ccbbe1a-e39d-4bc4-9bac-54cb905ddf8d-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Snapshots deleted, issuing volume delete {{(pid=87367) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3a0ae-ae71-4172-b5d2-74c7dde6aa0e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:58 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:58 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:58 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.485s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:58 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd Nov 04 19:14:58 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:58 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-645d7087-ba80-43bb-a855-fc9feb2b29dd" returned: 0 in 0.315s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-645d7087-ba80-43bb-a855-fc9feb2b29dd" released by "delete_volume" :: held 0.922s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['c6ca94a2-70b1-4cf9-b3aa-ad4ec1c8003f', '233a6aec-51f6-41be-8462-855b2608965e', 'cb25b902-1cdb-4da7-a524-a12f0d812fb7', '09117b60-c257-49b2-9036-f6144681a95d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:59 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:14:59 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e55631bf-dadc-4ce4-9a66-716743557cf2 req-ab69ac16-c452-4218-a8f1-11066553fa82 tempest-TestShelveInstance-2065277326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e55631bf-dadc-4ce4-9a66-716743557cf2 req-ab69ac16-c452-4218-a8f1-11066553fa82 tempest-TestShelveInstance-2065277326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-e55631bf-dadc-4ce4-9a66-716743557cf2 req-ab69ac16-c452-4218-a8f1-11066553fa82 tempest-TestShelveInstance-2065277326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-e55631bf-dadc-4ce4-9a66-716743557cf2 req-ab69ac16-c452-4218-a8f1-11066553fa82 tempest-TestShelveInstance-2065277326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3c492ba-93da-4ced-a48d-6b2fee2f43e4', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:14:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-e55631bf-dadc-4ce4-9a66-716743557cf2 req-ab69ac16-c452-4218-a8f1-11066553fa82 tempest-TestShelveInstance-2065277326 None] attachment_update completed successfully. Nov 04 19:14:59 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Deleted volume successfully. Nov 04 19:14:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3910d8f5-9d09-49f6-b81b-05e63f30c6a0 tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-645d7087-ba80-43bb-a855-fc9feb2b29dd-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-6fc3753d-d708-41c7-b97b-73df8b566212-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-6fc3753d-d708-41c7-b97b-73df8b566212-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb6678-50f2-45e8-a748-8bcef3dc8853]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:00 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 Nov 04 19:15:00 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:00 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212" returned: 0 in 0.423s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:00 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212 Nov 04 19:15:00 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:01 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6fc3753d-d708-41c7-b97b-73df8b566212" returned: 0 in 0.332s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-quobyte-6fc3753d-d708-41c7-b97b-73df8b566212" released by "delete_volume" :: held 0.818s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Created reservations ['82382f92-d687-4aa7-bc94-20044aab0f99', 'c9f7af83-ae9d-4e80-a2a4-6ee486e56cd5', '1d92872e-b497-4595-b73f-4895e0f1682d', '09bf3734-58d9-4257-8eb5-b1f44c60154e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:01 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:15:01 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:01 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.301s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:15:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Deleted volume successfully. Nov 04 19:15:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-62edb555-2888-4cb9-ab3d-8b23eb50567e tempest-VolumesDeleteCascade-1178839862 None] Lock "cinder-6fc3753d-d708-41c7-b97b-73df8b566212-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Flow 'volume_create_manager' (24d2f99c-a1d1-493d-adfb-b92d501abf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2f0d16-90d7-4a43-9910-7c349df68051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2f0d16-90d7-4a43-9910-7c349df68051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-861938274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7905b944-237f-4946-86e8-d52915edf9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3dc5236a784ed58f97ed9efc07b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:07Z,use_quota=True,user_id='8910ace86290450fad7e7b978c9c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea044c-465e-4ea6-be49-3226813257d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ea044c-465e-4ea6-be49-3226813257d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7e443-6a89-4791-90cb-efca41476388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f7e443-6a89-4791-90cb-efca41476388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7905b944-237f-4946-86e8-d52915edf9f9', 'volume_name': 'volume-7905b944-237f-4946-86e8-d52915edf9f9', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a3e3cf-b8a2-49fd-8a60-e7404452b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a3e3cf-b8a2-49fd-8a60-e7404452b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0d7a02-6168-4abf-8e3c-02ff075a3dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Volume 7905b944-237f-4946-86e8-d52915edf9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7905b944-237f-4946-86e8-d52915edf9f9', 'volume_size': 1} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-861938274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7905b944-237f-4946-86e8-d52915edf9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3dc5236a784ed58f97ed9efc07b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:07Z,use_quota=True,user_id='8910ace86290450fad7e7b978c9c448e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Creating volume 7905b944-237f-4946-86e8-d52915edf9f9 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:15:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:15:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:07 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 1073741824 Nov 04 19:15:07 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:08 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 1073741824" returned: 0 in 0.695s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:08 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 Nov 04 19:15:08 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:08 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9" returned: 0 in 0.431s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0d7a02-6168-4abf-8e3c-02ff075a3dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7905b944-237f-4946-86e8-d52915edf9f9', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb7eef4-312b-4781-8c9a-014bc2f0d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Volume volume-7905b944-237f-4946-86e8-d52915edf9f9 (7905b944-237f-4946-86e8-d52915edf9f9): created successfully Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb7eef4-312b-4781-8c9a-014bc2f0d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Flow 'volume_create_manager' (24d2f99c-a1d1-493d-adfb-b92d501abf9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e4231575-a7e6-486b-a485-50ee5d75892f tempest-VolumesMetadataTest-339319462 None] Created volume successfully. Nov 04 19:15:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Acquiring lock "cinder-7905b944-237f-4946-86e8-d52915edf9f9-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "cinder-7905b944-237f-4946-86e8-d52915edf9f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Acquiring lock "cinder-quobyte-7905b944-237f-4946-86e8-d52915edf9f9" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "cinder-quobyte-7905b944-237f-4946-86e8-d52915edf9f9" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae21fb6a-a483-4654-8dc9-d0606d8baedc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:11 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 Nov 04 19:15:11 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:11 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9" returned: 0 in 0.446s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:11 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9 Nov 04 19:15:11 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:11 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7905b944-237f-4946-86e8-d52915edf9f9" returned: 0 in 0.283s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "cinder-quobyte-7905b944-237f-4946-86e8-d52915edf9f9" released by "delete_volume" :: held 0.797s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Created reservations ['18d883fc-9afc-4843-86aa-26b7496ce2f0', '8383f04a-7d65-4112-9e69-4e46b30ced55', '3b980ccf-e6cd-4411-b544-ec5e4ff56e34', '62971d70-69f6-43ea-b33f-05dd83b52248'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:12 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:15:12 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:12 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:12 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:15:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Deleted volume successfully. Nov 04 19:15:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-628a213f-e49c-4eeb-84cc-9eb6e953d55b tempest-VolumesMetadataTest-339319462 None] Lock "cinder-7905b944-237f-4946-86e8-d52915edf9f9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Flow 'volume_create_manager' (2b51d598-769a-45b9-9964-e2ef9215a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e2ac5-b3ff-4e44-9025-6ce8488420f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e2ac5-b3ff-4e44-9025-6ce8488420f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-218334239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1124a70b-76ca-42fa-9d3a-662e85d6880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c44bc6075149c2af13277147ecfafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:21Z,use_quota=True,user_id='5ed782e90e4a4c4c887a555f2c187217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b234c9-0ff7-46f6-a156-4d1bf47a7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b234c9-0ff7-46f6-a156-4d1bf47a7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee86bbec-5811-469f-b06f-8bec9bb8ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee86bbec-5811-469f-b06f-8bec9bb8ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1124a70b-76ca-42fa-9d3a-662e85d6880f', 'volume_name': 'volume-1124a70b-76ca-42fa-9d3a-662e85d6880f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e074d3e3-a4c0-4f3d-9042-e87e3d3fd195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e074d3e3-a4c0-4f3d-9042-e87e3d3fd195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36d5c3c-d684-4160-b76d-f3665bc2addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume 1124a70b-76ca-42fa-9d3a-662e85d6880f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1124a70b-76ca-42fa-9d3a-662e85d6880f', 'volume_size': 1} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-218334239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1124a70b-76ca-42fa-9d3a-662e85d6880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c44bc6075149c2af13277147ecfafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:21Z,use_quota=True,user_id='5ed782e90e4a4c4c887a555f2c187217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Creating volume 1124a70b-76ca-42fa-9d3a-662e85d6880f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:15:21 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:21 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f 1073741824 Nov 04 19:15:21 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Flow 'volume_create_manager' (df5028d3-ac6e-4949-88a1-e3d8ff906272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5103e6ec-f3b8-484c-9e3f-2f4078e842d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5103e6ec-f3b8-484c-9e3f-2f4078e842d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-191885037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e71d17-2638-4bc4-a5af-464eab714f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c44bc6075149c2af13277147ecfafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:22Z,use_quota=True,user_id='5ed782e90e4a4c4c887a555f2c187217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c4d376-6431-4a3e-a1fa-2d35b0703ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c4d376-6431-4a3e-a1fa-2d35b0703ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbd3072-5f73-4fff-bed4-dc8e932949d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbd3072-5f73-4fff-bed4-dc8e932949d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e71d17-2638-4bc4-a5af-464eab714f63', 'volume_name': 'volume-79e71d17-2638-4bc4-a5af-464eab714f63', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124d3d1a-f26e-4173-8ab1-769d1140d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124d3d1a-f26e-4173-8ab1-769d1140d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a690ac9-acb9-4c30-bb40-0c9d3c17629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume 79e71d17-2638-4bc4-a5af-464eab714f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e71d17-2638-4bc4-a5af-464eab714f63', 'volume_size': 1} Nov 04 19:15:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:22 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f 1073741824" returned: 0 in 0.818s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:22 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:15:22 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:22 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f Nov 04 19:15:22 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:22 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.506s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:15:22 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f" returned: 0 in 0.494s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-191885037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e71d17-2638-4bc4-a5af-464eab714f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c44bc6075149c2af13277147ecfafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:22Z,use_quota=True,user_id='5ed782e90e4a4c4c887a555f2c187217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Creating volume 79e71d17-2638-4bc4-a5af-464eab714f63 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:15:22 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:15:22 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 1073741824 Nov 04 19:15:22 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36d5c3c-d684-4160-b76d-f3665bc2addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1124a70b-76ca-42fa-9d3a-662e85d6880f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457991d1-9b9a-4ce8-9fd8-fc6dbc178643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:22 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume volume-1124a70b-76ca-42fa-9d3a-662e85d6880f (1124a70b-76ca-42fa-9d3a-662e85d6880f): created successfully Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457991d1-9b9a-4ce8-9fd8-fc6dbc178643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Flow 'volume_create_manager' (2b51d598-769a-45b9-9964-e2ef9215a769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ece0d180-9b9c-4eb7-ac3d-701af87dfb2f tempest-TestServerVolumeAttachmentScenario-1071216767 None] Created volume successfully. Nov 04 19:15:23 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 1073741824" returned: 0 in 0.647s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:23 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 Nov 04 19:15:23 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:23 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a690ac9-acb9-4c30-bb40-0c9d3c17629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e71d17-2638-4bc4-a5af-464eab714f63', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f909ccaf-cc87-4897-8d26-1b0d77b516a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:23 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Volume volume-79e71d17-2638-4bc4-a5af-464eab714f63 (79e71d17-2638-4bc4-a5af-464eab714f63): created successfully Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f909ccaf-cc87-4897-8d26-1b0d77b516a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Flow 'volume_create_manager' (df5028d3-ac6e-4949-88a1-e3d8ff906272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4c3f95ef-5527-473c-a4e3-b149613a4fdf tempest-TestServerVolumeAttachmentScenario-1071216767 None] Created volume successfully. Nov 04 19:15:33 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:15:33 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=46,cinder:SELECT=37,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Flow 'volume_create_manager' (ecc6be29-241c-48e4-a2b4-e330d506deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb14833-4c31-4799-8bea-cd7436167e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb14833-4c31-4799-8bea-cd7436167e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527666581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7e1ad0-42da-4014-9f0b-6492ac3de135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6f67ebebde4a1f99104e9191104016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:35Z,use_quota=True,user_id='efc4023b13c348c19960bbf0c1018e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7886c99-94b1-4554-8d8e-2be74dce5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7886c99-94b1-4554-8d8e-2be74dce5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda731a-53ed-427b-b761-57c98ec0a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bda731a-53ed-427b-b761-57c98ec0a11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7e1ad0-42da-4014-9f0b-6492ac3de135', 'volume_name': 'volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f388491-8196-4af0-8a49-c1d9e418170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f388491-8196-4af0-8a49-c1d9e418170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96fcc5-5055-44f0-91da-316a69f001aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:35 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Volume ad7e1ad0-42da-4014-9f0b-6492ac3de135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135', 'volume_size': 1} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527666581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7e1ad0-42da-4014-9f0b-6492ac3de135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6f67ebebde4a1f99104e9191104016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:15:35Z,use_quota=True,user_id='efc4023b13c348c19960bbf0c1018e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Creating volume ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:15:35 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:35 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 1073741824 Nov 04 19:15:35 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:35 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 1073741824" returned: 0 in 0.470s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:35 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:15:35 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:35 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.286s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:15:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c96fcc5-5055-44f0-91da-316a69f001aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d157cd-8f4e-4585-a4d4-0d1bcc2dbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:15:36 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Volume volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 (ad7e1ad0-42da-4014-9f0b-6492ac3de135): created successfully Nov 04 19:15:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d157cd-8f4e-4585-a4d4-0d1bcc2dbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:15:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Flow 'volume_create_manager' (ecc6be29-241c-48e4-a2b4-e330d506deb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:15:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cebe62cc-4608-4c0b-aaa5-f287c349ea46 tempest-VolumesActionsTest-380768267 None] Created volume successfully. Nov 04 19:15:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-38dbbf1a-dc46-4797-b2b5-ee013421031d tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" by "attach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-38dbbf1a-dc46-4797-b2b5-ee013421031d tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" acquired by "attach_volume" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-38dbbf1a-dc46-4797-b2b5-ee013421031d tempest-VolumesActionsTest-380768267 None] Attaching volume ad7e1ad0-42da-4014-9f0b-6492ac3de135 to instance 46dc205c-f5cd-46ed-9843-fd94fed5c7ac at mountpoint /dev/vdb on host None. Nov 04 19:15:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-38dbbf1a-dc46-4797-b2b5-ee013421031d tempest-VolumesActionsTest-380768267 None] Attach volume completed successfully. Nov 04 19:15:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-38dbbf1a-dc46-4797-b2b5-ee013421031d tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" released by "attach_volume" :: held 0.157s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-72e7b3b9-06fb-40ed-90a2-7a3c4a780458 tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" by "detach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-72e7b3b9-06fb-40ed-90a2-7a3c4a780458 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:45 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-72e7b3b9-06fb-40ed-90a2-7a3c4a780458 tempest-VolumesActionsTest-380768267 None] Detaching volume ad7e1ad0-42da-4014-9f0b-6492ac3de135 from instance 46dc205c-f5cd-46ed-9843-fd94fed5c7ac. Nov 04 19:15:45 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-72e7b3b9-06fb-40ed-90a2-7a3c4a780458 tempest-VolumesActionsTest-380768267 None] Detach volume completed successfully. Nov 04 19:15:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-72e7b3b9-06fb-40ed-90a2-7a3c4a780458 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-0c9455bf-5f94-4c9c-b31f-134316bb6198 tempest-TestShelveInstance-2065277326 None] Terminate volume connection completed successfully. Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-0c9455bf-5f94-4c9c-b31f-134316bb6198 tempest-TestShelveInstance-2065277326 None] Deleting attachment c3c492ba-93da-4ced-a48d-6b2fee2f43e4. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Acquiring lock "cinder-763b9992-cbf7-4c6c-82f8-d78d3ca803b6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "cinder-763b9992-cbf7-4c6c-82f8-d78d3ca803b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Acquiring lock "cinder-quobyte-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "cinder-quobyte-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[54588159-3bd7-4373-9448-71153d216b51]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:15:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:48 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 Nov 04 19:15:48 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:48 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:48 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6 Nov 04 19:15:48 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:48 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" returned: 0 in 0.301s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "cinder-quobyte-763b9992-cbf7-4c6c-82f8-d78d3ca803b6" released by "delete_volume" :: held 0.803s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG cinder.quota [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Created reservations ['19b87c0f-f55d-4625-8049-3f220786ad1d', '900bf752-d35d-4d8e-85fb-e9551f371c82', '1a25ce5a-8a10-4474-bd9a-402e54c14487', '08ad69b3-ff8f-4778-a92d-0870874d59e9'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:15:48 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:15:48 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:15:49 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Nov 04 19:15:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.330s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:15:49 devstack cinder-volume[87367]: DEBUG cinder.manager [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:15:49 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Deleted volume successfully. Nov 04 19:15:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [req-2fc016b8-c027-4c82-8f41-e3e70e5b95d0 req-e340537c-e2a0-42b4-bda0-549285966b53 tempest-TestShelveInstance-2065277326 None] Lock "cinder-763b9992-cbf7-4c6c-82f8-d78d3ca803b6-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:15:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-51ef34d8-a7f7-4d97-901e-4ce88e82d00e req-9fc7743c-44fd-4506-ac58-cb1bbb2d0011 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:15:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-51ef34d8-a7f7-4d97-901e-4ce88e82d00e req-9fc7743c-44fd-4506-ac58-cb1bbb2d0011 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:15:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-51ef34d8-a7f7-4d97-901e-4ce88e82d00e req-9fc7743c-44fd-4506-ac58-cb1bbb2d0011 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:15:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-51ef34d8-a7f7-4d97-901e-4ce88e82d00e req-9fc7743c-44fd-4506-ac58-cb1bbb2d0011 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-1124a70b-76ca-42fa-9d3a-662e85d6880f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fb9714e-4ea6-4702-890f-e1d587335014', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:15:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-51ef34d8-a7f7-4d97-901e-4ce88e82d00e req-9fc7743c-44fd-4506-ac58-cb1bbb2d0011 tempest-TestServerVolumeAttachmentScenario-1071216767 None] attachment_update completed successfully. Nov 04 19:15:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-23e6885a-6628-4805-97c0-eadfed33e162 tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" by "attach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:15:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-23e6885a-6628-4805-97c0-eadfed33e162 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" acquired by "attach_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-23e6885a-6628-4805-97c0-eadfed33e162 tempest-VolumesActionsTest-380768267 None] Attaching volume ad7e1ad0-42da-4014-9f0b-6492ac3de135 to instance 40c6ec4e-6bce-4d35-9767-311a17f2b813 at mountpoint /dev/vdb on host None. Nov 04 19:16:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-23e6885a-6628-4805-97c0-eadfed33e162 tempest-VolumesActionsTest-380768267 None] Attach volume completed successfully. Nov 04 19:16:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-23e6885a-6628-4805-97c0-eadfed33e162 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135" released by "attach_volume" :: held 5.152s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6ca2606-92b2-46cf-be11-dedd6e9f04a8 tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" by "detach_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6ca2606-92b2-46cf-be11-dedd6e9f04a8 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b6ca2606-92b2-46cf-be11-dedd6e9f04a8 tempest-VolumesActionsTest-380768267 None] Detaching volume ad7e1ad0-42da-4014-9f0b-6492ac3de135 from instance 40c6ec4e-6bce-4d35-9767-311a17f2b813. Nov 04 19:16:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b6ca2606-92b2-46cf-be11-dedd6e9f04a8 tempest-VolumesActionsTest-380768267 None] Detach volume completed successfully. Nov 04 19:16:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b6ca2606-92b2-46cf-be11-dedd6e9f04a8 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3964dfc1-ae41-4541-b962-e60d36bf8d4b req-abe20d03-4cd1-4c13-b6a1-8c9098c3701a tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3964dfc1-ae41-4541-b962-e60d36bf8d4b req-abe20d03-4cd1-4c13-b6a1-8c9098c3701a tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [req-3964dfc1-ae41-4541-b962-e60d36bf8d4b req-abe20d03-4cd1-4c13-b6a1-8c9098c3701a tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-3964dfc1-ae41-4541-b962-e60d36bf8d4b req-abe20d03-4cd1-4c13-b6a1-8c9098c3701a tempest-TestServerVolumeAttachmentScenario-1071216767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f', 'name': 'volume-79e71d17-2638-4bc4-a5af-464eab714f63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2236226a-05e9-4325-843f-4ac17a24198d', 'enforce_multipath': True} {{(pid=87367) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:16:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-3964dfc1-ae41-4541-b962-e60d36bf8d4b req-abe20d03-4cd1-4c13-b6a1-8c9098c3701a tempest-TestServerVolumeAttachmentScenario-1071216767 None] attachment_update completed successfully. Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2e766-04d0-433c-81e6-7deea0d305c1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:09 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:09 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-f2341b34-9c48-4ab3-8f5a-d05e2f63b6c4 req-574b91bc-7a28-42b7-bdd3-4700ee02a61c tempest-TestServerVolumeAttachmentScenario-1071216767 None] Terminate volume connection completed successfully. Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-f2341b34-9c48-4ab3-8f5a-d05e2f63b6c4 req-574b91bc-7a28-42b7-bdd3-4700ee02a61c tempest-TestServerVolumeAttachmentScenario-1071216767 None] Deleting attachment 2236226a-05e9-4325-843f-4ac17a24198d. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:16:09 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.444s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b36b85-ea20-4805-a5d6-e37c16c6972c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:09 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:09 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:10 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.8d0b9a91-bbff-4d32-a912-576ca3ef12d7bkzvr1rg.img {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:10 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.8d0b9a91-bbff-4d32-a912-576ca3ef12d7bkzvr1rg.img Nov 04 19:16:10 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [req-88a1b8f0-396f-468d-82b3-2e42178b220f req-efc430bb-ca6c-4713-b17f-a3d6fdba394b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Terminate volume connection completed successfully. Nov 04 19:16:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [req-88a1b8f0-396f-468d-82b3-2e42178b220f req-efc430bb-ca6c-4713-b17f-a3d6fdba394b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Deleting attachment 2fb9714e-4ea6-4702-890f-e1d587335014. {{(pid=87367) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:16:18 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.8d0b9a91-bbff-4d32-a912-576ca3ef12d7bkzvr1rg.img" returned: 0 in 8.664s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c0cafb-894e-4b78-9947-b2531597c6d2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:18 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:18 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "cinder-79e71d17-2638-4bc4-a5af-464eab714f63-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-79e71d17-2638-4bc4-a5af-464eab714f63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "cinder-quobyte-79e71d17-2638-4bc4-a5af-464eab714f63" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-quobyte-79e71d17-2638-4bc4-a5af-464eab714f63" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad77e7-c6ce-4ea1-884d-bd8622ced9d3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:19 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 Nov 04 19:16:19 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:19 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.638s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.8d0b9a91-bbff-4d32-a912-576ca3ef12d7bkzvr1rg.img {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:16:19 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Converted 1024.00 MB image at 118.18 MB/s Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] 8d0b9a91-bbff-4d32-a912-576ca3ef12d7 was raw, no need to convert to raw {{(pid=87367) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 19:16:19 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:19 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63 Nov 04 19:16:19 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:19 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-79e71d17-2638-4bc4-a5af-464eab714f63" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-quobyte-79e71d17-2638-4bc4-a5af-464eab714f63" released by "delete_volume" :: held 0.788s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Created reservations ['bfed3a26-8eb9-4f78-9b5c-bbaf57a2af27', 'f4a82be6-f7a6-4439-b993-95f19f9438ac', '7dfb0d66-a759-490d-9102-9401803d8b47', 'eaa85cdd-de53-4131-ba63-f0425ae600f5'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:20 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:16:20 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "cinder-1124a70b-76ca-42fa-9d3a-662e85d6880f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-1124a70b-76ca-42fa-9d3a-662e85d6880f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:20 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.308s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "cinder-quobyte-1124a70b-76ca-42fa-9d3a-662e85d6880f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Deleted volume successfully. Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-223c5ed4-27d8-4775-a945-294b3d91a221 tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-79e71d17-2638-4bc4-a5af-464eab714f63-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-quobyte-1124a70b-76ca-42fa-9d3a-662e85d6880f" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867c19b-827b-4507-8d0f-77d4e3934b7f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:20 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f Nov 04 19:16:20 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:20 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f" returned: 0 in 0.507s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:20 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f Nov 04 19:16:20 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:21 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1124a70b-76ca-42fa-9d3a-662e85d6880f" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-quobyte-1124a70b-76ca-42fa-9d3a-662e85d6880f" released by "delete_volume" :: held 0.840s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Created reservations ['3d9d8cd6-0968-4118-832a-e50cc23974e1', 'be9a04ea-bcbd-4a69-a8a4-cadce3800e91', 'b9ad3c47-6191-47cc-9742-77fecbaec23c', 'cd6bed75-c498-4546-87ea-410df9b42810'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:21 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:16:21 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:21 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:16:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Deleted volume successfully. Nov 04 19:16:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-001c1b4e-e41d-4b03-bd0f-c6c7220caf5b tempest-TestServerVolumeAttachmentScenario-1071216767 None] Lock "cinder-1124a70b-76ca-42fa-9d3a-662e85d6880f-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:22 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:16:22 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:22 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.348s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:16:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:16:31 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=51,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:16:31 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=45,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (08d19b94-d221-47a5-b014-ac8c54e19d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bd44bc-c0e7-4b3f-bf1f-ba13eb9f62b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bd44bc-c0e7-4b3f-bf1f-ba13eb9f62b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418399582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:40Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc31b93f-a9fd-46e7-b7f4-c97d6c067f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc31b93f-a9fd-46e7-b7f4-c97d6c067f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ece1e13-8af2-466a-94ee-05c65f7a3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ece1e13-8af2-466a-94ee-05c65f7a3659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae', 'volume_name': 'volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e521b5-f494-4055-a72c-be8b521bc3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e521b5-f494-4055-a72c-be8b521bc3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcabd78-985b-4d1f-b2b0-5dca0e1039e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:40 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume 6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae', 'volume_size': 1} Nov 04 19:16:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Flow 'volume_create_manager' (6fa1192e-ccb7-4721-8790-7d234e4472a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7fd3d7-3eb1-463f-9301-ec644dd4370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7fd3d7-3eb1-463f-9301-ec644dd4370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-924082894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c980ab60-e051-4597-9f8b-5174ac57e1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902cb6a0f02140af807b8f78da13b03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:42Z,use_quota=True,user_id='83ed2274c6e34dc6b85ba4df13873214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71824800-d452-44f3-a99f-72270a1c1dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71824800-d452-44f3-a99f-72270a1c1dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f3c28-5f35-49bc-a838-437ed4df88b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f3c28-5f35-49bc-a838-437ed4df88b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c980ab60-e051-4597-9f8b-5174ac57e1be', 'volume_name': 'volume-c980ab60-e051-4597-9f8b-5174ac57e1be', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb57234-c4dd-43a2-a9aa-6ab98fdc68e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb57234-c4dd-43a2-a9aa-6ab98fdc68e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b978ae32-d1d3-4d61-9e29-41f88db68ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:41 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Volume c980ab60-e051-4597-9f8b-5174ac57e1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c980ab60-e051-4597-9f8b-5174ac57e1be', 'volume_size': 1} Nov 04 19:16:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.785s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Uploaded volume to glance image-id: 8d0b9a91-bbff-4d32-a912-576ca3ef12d7. {{(pid=87367) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.652s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418399582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:40Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume 6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:16:44 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:44 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae 1073741824 Nov 04 19:16:44 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3bc4cd39-b860-4349-91c6-e3e74dcc6ae3 tempest-VolumesActionsTest-380768267 None] Copy volume to image completed successfully. Nov 04 19:16:44 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae 1073741824" returned: 0 in 0.426s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:44 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae Nov 04 19:16:44 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:44 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.992s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-924082894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c980ab60-e051-4597-9f8b-5174ac57e1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902cb6a0f02140af807b8f78da13b03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:42Z,use_quota=True,user_id='83ed2274c6e34dc6b85ba4df13873214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Creating volume c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:16:44 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:44 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be 1073741824 Nov 04 19:16:44 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcabd78-985b-4d1f-b2b0-5dca0e1039e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aba699-b132-4b41-a418-e82d84e1ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae (6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae): created successfully Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85aba699-b132-4b41-a418-e82d84e1ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (08d19b94-d221-47a5-b014-ac8c54e19d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-da14b821-cbc0-4c98-befa-12ba681059ba tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:16:45 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be 1073741824" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:45 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:16:45 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:45 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.263s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b978ae32-d1d3-4d61-9e29-41f88db68ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c980ab60-e051-4597-9f8b-5174ac57e1be', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947406e5-a697-4861-91f0-abdcb5e28e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:45 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Volume volume-c980ab60-e051-4597-9f8b-5174ac57e1be (c980ab60-e051-4597-9f8b-5174ac57e1be): created successfully Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947406e5-a697-4861-91f0-abdcb5e28e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Flow 'volume_create_manager' (6fa1192e-ccb7-4721-8790-7d234e4472a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:45 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cb803814-1887-49a9-b149-25989983ebbd tempest-TestImageHashVerification-293971843 None] Created volume successfully. Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (32c16a28-f2e8-48f2-b2f1-6867e5e08250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d600c0-40a8-4dd3-8912-35dda6879e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[58124f38-c7ce-4318-b202-cb659fa40ddb]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d600c0-40a8-4dd3-8912-35dda6879e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625837174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6217a9-13cb-4b0d-98c1-3d6e570d1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:46Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0be04e4-0554-4e98-a9f1-fd830064250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0be04e4-0554-4e98-a9f1-fd830064250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0069382a-c994-4e10-bbbe-a616a503301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0069382a-c994-4e10-bbbe-a616a503301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6217a9-13cb-4b0d-98c1-3d6e570d1fa8', 'volume_name': 'volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5159592-79dc-439b-ad7f-bb02fd787d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5159592-79dc-439b-ad7f-bb02fd787d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d745eec-93e9-4f79-acb0-bd163fd2d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume de6217a9-13cb-4b0d-98c1-3d6e570d1fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8', 'volume_size': 1} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:46 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:46 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (b0bfce50-92cb-46dd-9b69-77c5c606b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b8159a-779c-4522-b4dd-b40c02512732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.465s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b8159a-779c-4522-b4dd-b40c02512732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317443675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e6ee73-b063-4200-b487-bc1f2ee3e0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:46Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdaa165-8ff3-4531-93bc-c1ab54e1ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdaa165-8ff3-4531-93bc-c1ab54e1ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a27455e-1be2-4a98-8072-ecaa021b9f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a27455e-1be2-4a98-8072-ecaa021b9f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e6ee73-b063-4200-b487-bc1f2ee3e0ad', 'volume_name': 'volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd58b46-e600-41cf-a941-95ef93085536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd58b46-e600-41cf-a941-95ef93085536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef16ff5-d820-473e-b983-d8cc9a80188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume 62e6ee73-b063-4200-b487-bc1f2ee3e0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad', 'volume_size': 1} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[076d9675-4f4e-4eac-972c-20796fd9ae10]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:46 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:46 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (623382b2-3aef-4d03-bdde-abf14cb70a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1892ff08-7ef1-4bba-b42a-d79084227789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1892ff08-7ef1-4bba-b42a-d79084227789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801229409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ab9939-c06a-4356-9382-f65953a55e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:47Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1fcc8e-4c31-4522-a67c-4363eae74c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1fcc8e-4c31-4522-a67c-4363eae74c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b24290-69b1-488c-9151-e5464bd9e8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b24290-69b1-488c-9151-e5464bd9e8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ab9939-c06a-4356-9382-f65953a55e1b', 'volume_name': 'volume-e5ab9939-c06a-4356-9382-f65953a55e1b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7831de83-4ea5-4a98-8400-a5a2ae2c5e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7831de83-4ea5-4a98-8400-a5a2ae2c5e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d53675-f709-4e6d-bd5c-6d890e630713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume e5ab9939-c06a-4356-9382-f65953a55e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ab9939-c06a-4356-9382-f65953a55e1b', 'volume_size': 1} Nov 04 19:16:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:47 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.468s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:47 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img Nov 04 19:16:47 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (141a9e7c-452e-4617-a532-c65273b67fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12f7bd3-ba67-42ff-af39-6330c3720058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12f7bd3-ba67-42ff-af39-6330c3720058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894172568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6997ba8-4fed-4613-bfb4-3e1a06fd28f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:47Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ad6365-1fa0-4109-b2f6-098b9bc34d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ad6365-1fa0-4109-b2f6-098b9bc34d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1b3f5-651c-4045-ad0b-4435fe4d581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1b3f5-651c-4045-ad0b-4435fe4d581e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6997ba8-4fed-4613-bfb4-3e1a06fd28f5', 'volume_name': 'volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443750d9-96c2-4c67-8489-f20fd381d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443750d9-96c2-4c67-8489-f20fd381d1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b610d4-0425-4c7f-a000-81e6722dbbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:47 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume e6997ba8-4fed-4613-bfb4-3e1a06fd28f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5', 'volume_size': 1} Nov 04 19:16:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (b17c38ba-6dfe-438e-9e59-9f3049cf6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb2ec73-62c9-44f0-9f0d-e9ef9e976e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb2ec73-62c9-44f0-9f0d-e9ef9e976e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993570606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e617593-8f6a-47af-8f69-9bac35949c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:48Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b02140-08f4-4db0-aa15-bcc4473f7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b02140-08f4-4db0-aa15-bcc4473f7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b20b17-7f99-4999-aeb7-262d34f8e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b20b17-7f99-4999-aeb7-262d34f8e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e617593-8f6a-47af-8f69-9bac35949c56', 'volume_name': 'volume-0e617593-8f6a-47af-8f69-9bac35949c56', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c534618d-fc41-4e54-a7b5-da3f23b4ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c534618d-fc41-4e54-a7b5-da3f23b4ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d420605-4d75-4058-8952-0711be7edb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:48 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume 0e617593-8f6a-47af-8f69-9bac35949c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e617593-8f6a-47af-8f69-9bac35949c56', 'volume_size': 1} Nov 04 19:16:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:52 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img" returned: 0 in 5.896s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:52 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d43dfc7-6cb6-4a67-892d-9a3d63e66390]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:53 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:53 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:53 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.512s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:16:53 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Converted 1024.00 MB image at 173.66 MB/s Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] c38a987e-beef-48ce-9290-c1a4b41f5f9e was raw, converting to qcow2 {{(pid=87367) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a402dc3-671f-46a2-ab74-63f958891284]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:53 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img Nov 04 19:16:53 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:53 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img" returned: 0 in 0.333s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:53 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img Nov 04 19:16:53 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:54 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img" returned: 1 in 0.315s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:54 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn Nov 04 19:16:54 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:54 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Image conversion details: src /opt/stack/data/cinder/conversion/ad7e1ad0-42da-4014-9f0b-6492ac3de135.temp_image.c38a987e-beef-48ce-9290-c1a4b41f5f9e95mcnjpd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:16:54 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e27ec-8f36-425b-a33b-bc53df5850af]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:54 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn Nov 04 19:16:54 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:54 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gsx_b3nn" returned: 0 in 0.324s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.981s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Uploaded volume to glance image-id: c38a987e-beef-48ce-9290-c1a4b41f5f9e. {{(pid=87367) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.850s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-625837174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6217a9-13cb-4b0d-98c1-3d6e570d1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:46Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:16:55 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:16:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:55 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 1073741824 Nov 04 19:16:55 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-bb7f5d17-e5ba-4b60-b66d-3e7933e27c48 tempest-VolumesActionsTest-380768267 None] Copy volume to image completed successfully. Nov 04 19:16:56 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 1073741824" returned: 0 in 0.424s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:56 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 Nov 04 19:16:56 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:56 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" returned: 0 in 0.262s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.151s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317443675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e6ee73-b063-4200-b487-bc1f2ee3e0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:46Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume 62e6ee73-b063-4200-b487-bc1f2ee3e0ad {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:16:56 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:56 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad 1073741824 Nov 04 19:16:56 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d745eec-93e9-4f79-acb0-bd163fd2d38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2bf50-b7c3-4dcf-842d-29be3a703f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 (de6217a9-13cb-4b0d-98c1-3d6e570d1fa8): created successfully Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2bf50-b7c3-4dcf-842d-29be3a703f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (32c16a28-f2e8-48f2-b2f1-6867e5e08250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-27337ed9-a6d4-4af9-a78c-0a5b01b2e6b0 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Acquiring lock "cinder-quobyte-ad7e1ad0-42da-4014-9f0b-6492ac3de135" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "cinder-quobyte-ad7e1ad0-42da-4014-9f0b-6492ac3de135" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeb8f97-7be9-4718-af45-394abadbfbf0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:57 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad 1073741824" returned: 0 in 0.490s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:57 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad Nov 04 19:16:57 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:57 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:57 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:57 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" returned: 0 in 0.262s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.570s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801229409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ab9939-c06a-4356-9382-f65953a55e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:47Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume e5ab9939-c06a-4356-9382-f65953a55e1b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:16:57 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:57 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:57 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b 1073741824 Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef16ff5-d820-473e-b983-d8cc9a80188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:57 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a26b4-aa4f-44ca-80a1-4bf2c206c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad (62e6ee73-b063-4200-b487-bc1f2ee3e0ad): created successfully Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38a26b4-aa4f-44ca-80a1-4bf2c206c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:57 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135 Nov 04 19:16:57 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (b0bfce50-92cb-46dd-9b69-77c5c606b04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-59da1da7-8796-4f44-9eeb-7392f7ca1d68 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:16:57 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad7e1ad0-42da-4014-9f0b-6492ac3de135" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "cinder-quobyte-ad7e1ad0-42da-4014-9f0b-6492ac3de135" released by "delete_volume" :: held 0.701s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Created reservations ['13c27d47-2fa6-46f2-865d-ead38e895984', '9120cade-7b05-4327-a5ff-b5d7f41ee944', 'a28b135b-aad5-4399-9cc1-46edbbcc0837', 'cdb5f3cd-ab7e-49ac-ac38-10b27c89197c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:57 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b 1073741824" returned: 0 in 0.481s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:58 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:16:58 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:58 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b Nov 04 19:16:58 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:58 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:16:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Deleted volume successfully. Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b974268a-e367-487c-bd48-4ac5efd6a9e5 tempest-VolumesActionsTest-380768267 None] Lock "cinder-ad7e1ad0-42da-4014-9f0b-6492ac3de135-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:16:58 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b" returned: 0 in 0.268s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.185s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d53675-f709-4e6d-bd5c-6d890e630713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ab9939-c06a-4356-9382-f65953a55e1b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3658057e-fbaf-4700-8a8d-dbc95fb015d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a9f1d-ec94-4a96-9e8e-72906301870c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:58 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-e5ab9939-c06a-4356-9382-f65953a55e1b (e5ab9939-c06a-4356-9382-f65953a55e1b): created successfully Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3658057e-fbaf-4700-8a8d-dbc95fb015d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (623382b2-3aef-4d03-bdde-abf14cb70a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:16:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dd122481-b7f3-4ba3-870d-85a6c916e29b tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:16:58 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:16:58 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:58 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5f4a6-91c2-4756-b602-b10f3877ffdc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:16:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:58 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:16:58 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:16:59 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 04 19:16:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:16:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be /opt/stack/data/cinder/conversion/c980ab60-e051-4597-9f8b-5174ac57e1be.temp_image.dcee8003-18b9-4782-ac2b-107fd9b87d93zl1vtvtc.img {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:16:59 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be /opt/stack/data/cinder/conversion/c980ab60-e051-4597-9f8b-5174ac57e1be.temp_image.dcee8003-18b9-4782-ac2b-107fd9b87d93zl1vtvtc.img Nov 04 19:16:59 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:05 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be /opt/stack/data/cinder/conversion/c980ab60-e051-4597-9f8b-5174ac57e1be.temp_image.dcee8003-18b9-4782-ac2b-107fd9b87d93zl1vtvtc.img" returned: 0 in 6.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e31e6-6834-47f9-9436-bd2b5baf6de1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:05 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:17:05 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:06 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.561s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:06 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/conversion/c980ab60-e051-4597-9f8b-5174ac57e1be.temp_image.dcee8003-18b9-4782-ac2b-107fd9b87d93zl1vtvtc.img {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:17:06 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Converted 1024.00 MB image at 160.07 MB/s Nov 04 19:17:06 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] dcee8003-18b9-4782-ac2b-107fd9b87d93 was raw, no need to convert to raw {{(pid=87367) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Flow 'volume_create_manager' (99ee73e1-820f-47e9-a49a-d9dbcda2e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a91403d-1340-4795-a164-675bd2aa9836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a91403d-1340-4795-a164-675bd2aa9836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-733612464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c913ecf-3701-423a-8b9e-b675721888d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d0cc232b9349f4a4bd67d810f5fbe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:08Z,use_quota=True,user_id='0ae3f461910e4bb5b45162fcc0e98ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d01fedc-cea5-43e5-8e0c-181b1b7bdf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d01fedc-cea5-43e5-8e0c-181b1b7bdf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf466b7f-1332-419d-becf-fa5de2e45181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf466b7f-1332-419d-becf-fa5de2e45181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c913ecf-3701-423a-8b9e-b675721888d3', 'volume_name': 'volume-6c913ecf-3701-423a-8b9e-b675721888d3', 'volume_size': 2}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a443ad-6b11-4295-ba7b-053dc755437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a443ad-6b11-4295-ba7b-053dc755437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1c3fe-c740-4cbd-a26b-4cd714341ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Volume 6c913ecf-3701-423a-8b9e-b675721888d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c913ecf-3701-423a-8b9e-b675721888d3', 'volume_size': 2} Nov 04 19:17:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:18 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:17:18 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:22 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:22 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:22 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.284s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:17:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.246s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Uploaded volume to glance image-id: dcee8003-18b9-4782-ac2b-107fd9b87d93. {{(pid=87367) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.279s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894172568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6997ba8-4fed-4613-bfb4-3e1a06fd28f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:47Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:24 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:24 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 1073741824 Nov 04 19:17:24 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dd386dbc-8bf0-4ef8-9cca-f20c84ebdd3d tempest-TestImageHashVerification-293971843 None] Copy volume to image completed successfully. Nov 04 19:17:24 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 1073741824" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:25 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 Nov 04 19:17:25 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:25 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.793s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993570606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e617593-8f6a-47af-8f69-9bac35949c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bddb15e6b0204685b7511dd630f70e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:16:48Z,use_quota=True,user_id='155df6c4063a449aaedb2a9e700a36da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Creating volume 0e617593-8f6a-47af-8f69-9bac35949c56 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:25 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b610d4-0425-4c7f-a000-81e6722dbbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:25 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 1073741824 Nov 04 19:17:25 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd47b272-b8ba-4d53-8ad2-f2231f24ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 (e6997ba8-4fed-4613-bfb4-3e1a06fd28f5): created successfully Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd47b272-b8ba-4d53-8ad2-f2231f24ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (141a9e7c-452e-4617-a532-c65273b67fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ae912a41-ee6a-48d4-a67b-72c3d8ebe173 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:17:25 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 1073741824" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:25 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 Nov 04 19:17:25 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:25 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.457s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-733612464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c913ecf-3701-423a-8b9e-b675721888d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0d0cc232b9349f4a4bd67d810f5fbe8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:08Z,use_quota=True,user_id='0ae3f461910e4bb5b45162fcc0e98ac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Creating volume 6c913ecf-3701-423a-8b9e-b675721888d3 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:25 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 2147483648 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d420605-4d75-4058-8952-0711be7edb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e617593-8f6a-47af-8f69-9bac35949c56', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:26 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 2147483648 Nov 04 19:17:26 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ed24ed-3061-4537-8dca-01c62ccc9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Volume volume-0e617593-8f6a-47af-8f69-9bac35949c56 (0e617593-8f6a-47af-8f69-9bac35949c56): created successfully Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ed24ed-3061-4537-8dca-01c62ccc9975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Flow 'volume_create_manager' (b17c38ba-6dfe-438e-9e59-9f3049cf6349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c759d6ea-7515-4c72-be6a-b28cd9041226 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created volume successfully. Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Acquiring lock "cinder-c980ab60-e051-4597-9f8b-5174ac57e1be-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "cinder-c980ab60-e051-4597-9f8b-5174ac57e1be-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Acquiring lock "cinder-quobyte-c980ab60-e051-4597-9f8b-5174ac57e1be" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-0e617593-8f6a-47af-8f69-9bac35949c56-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "cinder-quobyte-c980ab60-e051-4597-9f8b-5174ac57e1be" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-0e617593-8f6a-47af-8f69-9bac35949c56-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2262db67-491e-4c23-8288-26f3d0c4369c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-0e617593-8f6a-47af-8f69-9bac35949c56" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-0e617593-8f6a-47af-8f69-9bac35949c56" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd8eef-47e9-48f9-892b-bfd7c26a4fa6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:17:26 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 Nov 04 19:17:26 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 2147483648" returned: 0 in 0.612s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 Nov 04 19:17:26 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.447s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be Nov 04 19:17:26 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56" returned: 0 in 0.441s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:26 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56 Nov 04 19:17:26 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:26 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3" returned: 0 in 0.269s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1c3fe-c740-4cbd-a26b-4cd714341ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c913ecf-3701-423a-8b9e-b675721888d3', 'volume_size': 2}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beffa6de-3289-4121-968b-3cdeaf1fd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Volume volume-6c913ecf-3701-423a-8b9e-b675721888d3 (6c913ecf-3701-423a-8b9e-b675721888d3): created successfully Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beffa6de-3289-4121-968b-3cdeaf1fd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Flow 'volume_create_manager' (99ee73e1-820f-47e9-a49a-d9dbcda2e12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9a9cc422-9166-4e4e-b635-06f4b3cd4152 tempest-VolumesCloneNegativeTest-1505349730 None] Created volume successfully. Nov 04 19:17:27 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c980ab60-e051-4597-9f8b-5174ac57e1be" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "cinder-quobyte-c980ab60-e051-4597-9f8b-5174ac57e1be" released by "delete_volume" :: held 0.777s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Created reservations ['8f7d66a3-f156-47a3-adf1-9408de934fe2', 'ed52b375-d5b7-4da1-9d61-4f4a1a9289ac', '7213d8b3-933d-4712-a15a-68d83b76fbb1', 'fd27522e-f718-4ae7-8fc1-876e95df603e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:27 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0e617593-8f6a-47af-8f69-9bac35949c56" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-0e617593-8f6a-47af-8f69-9bac35949c56" released by "delete_volume" :: held 0.773s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:27 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:27 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['0f11375a-9393-4056-927d-bc72af44cbdb', 'ed331cf3-e165-41e0-9806-633a5034547b', '2ad037a3-ee85-4c3e-92c6-8098a16e2dc4', 'fa22197f-b4c4-4119-933f-738353dea113'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:27 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:27 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:27 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Deleted volume successfully. Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0f78190d-1604-42d3-9619-bacfe2b152fa tempest-TestImageHashVerification-293971843 None] Lock "cinder-c980ab60-e051-4597-9f8b-5174ac57e1be-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77ee0b9-b760-47fc-996f-73fd7a392935]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:27 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.371s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-088bf481-bc0f-4ab4-933c-ad92fcdb2b77 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-0e617593-8f6a-47af-8f69-9bac35949c56-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:27 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 Nov 04 19:17:27 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Acquiring lock "cinder-6c913ecf-3701-423a-8b9e-b675721888d3-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "cinder-6c913ecf-3701-423a-8b9e-b675721888d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Acquiring lock "cinder-quobyte-6c913ecf-3701-423a-8b9e-b675721888d3" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "cinder-quobyte-6c913ecf-3701-423a-8b9e-b675721888d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d37229-c7f7-40b1-8e18-efc67013ee7f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:28 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 Nov 04 19:17:28 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:28 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" returned: 0 in 0.431s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:28 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5 Nov 04 19:17:28 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:28 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3" returned: 0 in 0.482s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:28 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" returned: 0 in 0.342s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:28 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3 Nov 04 19:17:28 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5" released by "delete_volume" :: held 0.841s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['b929edfa-2e70-4727-995c-7c7e02454bc4', '2746d9a7-6f64-401a-8464-929ec27ddd56', 'b2ea4d31-d73d-4dce-bf0d-8274ffde6395', '533fbe9c-de91-40b6-b9d7-897d4ee2af71'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:28 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:28 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-e5ab9939-c06a-4356-9382-f65953a55e1b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-e5ab9939-c06a-4356-9382-f65953a55e1b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:28 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c913ecf-3701-423a-8b9e-b675721888d3" returned: 0 in 0.342s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "cinder-quobyte-6c913ecf-3701-423a-8b9e-b675721888d3" released by "delete_volume" :: held 0.893s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-e5ab9939-c06a-4356-9382-f65953a55e1b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-e5ab9939-c06a-4356-9382-f65953a55e1b" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f66955-be6f-4717-9b52-5f73523bc4ed]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:28 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Created reservations ['896cc07f-ec92-4400-9720-e91d629eab7e', '882814cf-7ac0-4387-9d65-2a1139b8cbd0', 'eb79636d-fead-4fec-b9ae-2b83d8a2e067', 'c48f4ded-a105-460d-9a93-f5bf5570b0db'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:29 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:29 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:29 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b Nov 04 19:17:29 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:29 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9c2e269a-986c-4b33-a703-772de52ed9da tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-e6997ba8-4fed-4613-bfb4-3e1a06fd28f5-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:29 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.330s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Deleted volume successfully. Nov 04 19:17:29 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b" returned: 0 in 0.502s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f4fc2e20-2436-461c-be16-e12f128969ba tempest-VolumesCloneNegativeTest-1505349730 None] Lock "cinder-6c913ecf-3701-423a-8b9e-b675721888d3-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:29 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b Nov 04 19:17:29 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:29 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e5ab9939-c06a-4356-9382-f65953a55e1b" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-e5ab9939-c06a-4356-9382-f65953a55e1b" released by "delete_volume" :: held 0.804s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['5d60ef2e-3ba2-45ed-8f47-4589480e7b4f', '2b590934-5b9c-4585-a216-cb019cb844d5', 'ce9ed023-1e1e-4ecc-9c39-87a59b185de7', '9582af54-67e6-43b3-956a-f405f72db177'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:29 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:29 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-62e6ee73-b063-4200-b487-bc1f2ee3e0ad-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-62e6ee73-b063-4200-b487-bc1f2ee3e0ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[943ab42c-3b99-420b-b5c9-717bc04548a8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:30 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef5a3c9b-0fdd-4798-b09d-1f9a57c915e3 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-e5ab9939-c06a-4356-9382-f65953a55e1b-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:30 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad Nov 04 19:17:30 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:30 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:30 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad Nov 04 19:17:30 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:30 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" returned: 0 in 0.269s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-62e6ee73-b063-4200-b487-bc1f2ee3e0ad" released by "delete_volume" :: held 0.776s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['8bd2bc59-2ba2-4292-a7e4-780909f9ed8f', 'f96c6019-b49e-413f-8769-e952625f04c6', '285f0505-c590-46c6-9817-91337e956c99', '0e842b8b-50ad-4ce6-a5e2-33ada38dc112'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:30 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:30 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:31 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.345s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:31 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd7e9e-ff49-4e53-bc24-d2d8a95644d0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1cd5928d-4051-4134-a7dd-192e4bb914d9 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-62e6ee73-b063-4200-b487-bc1f2ee3e0ad-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:31 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 Nov 04 19:17:31 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:31 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" returned: 0 in 0.468s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:31 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8 Nov 04 19:17:31 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:32 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" returned: 0 in 0.329s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8" released by "delete_volume" :: held 0.883s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['145f7695-97fd-411b-b302-efc79ebb4b98', 'ac863b56-634b-4409-a672-4e384648f73c', '6209827e-4f9c-46bd-a1c8-05a462f2ab79', '72af7091-05ac-49bc-87d0-25be30d499da'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:32 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:32 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "cinder-quobyte-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b6f7e-18b9-4ae3-b3ea-c02222063384]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:32 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.491s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:32 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae Nov 04 19:17:32 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-659753d2-6ce5-4292-8fde-2844aafe2f49 tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-de6217a9-13cb-4b0d-98c1-3d6e570d1fa8-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:33 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" returned: 0 in 0.468s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:33 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae Nov 04 19:17:33 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:33 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" returned: 0 in 0.266s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-quobyte-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae" released by "delete_volume" :: held 0.824s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Created reservations ['1132628b-06fb-4806-a557-11cdda0a5aeb', '626e6377-4820-4ead-98b0-270191aabf89', 'b2de0a41-1f52-481d-a42e-c828e233b729', 'f234b908-9aea-422e-ba59-a8359cbd72fe'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:33 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:33 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:33 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.331s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:33 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Deleted volume successfully. Nov 04 19:17:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-49222545-b2b3-4e42-82e8-56c1eb882eca tempest-CreateVolumesFromSourceVolumeTest-393418479 None] Lock "cinder-6c1f78ab-a92c-42f8-aa64-04ce3a37b2ae-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (5bed0b28-6fa2-4dbd-861a-e23eb225536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c927fa-420d-4707-98ac-a482511ee988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c927fa-420d-4707-98ac-a482511ee988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-736495212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86e8f4-36ba-41af-a6ff-ce67179401a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:35Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0d8c03-11c7-408f-af6b-b722b5901459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0d8c03-11c7-408f-af6b-b722b5901459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d53175b-494d-4aea-a4da-685afd1992f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d53175b-494d-4aea-a4da-685afd1992f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b86e8f4-36ba-41af-a6ff-ce67179401a8', 'volume_name': 'volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f471b-5253-4048-86fc-612788ea4f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f471b-5253-4048-86fc-612788ea4f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea436e-e25a-40b5-a6d2-9d6205af1a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:35 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Volume 2b86e8f4-36ba-41af-a6ff-ce67179401a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8', 'volume_size': 1} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-736495212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86e8f4-36ba-41af-a6ff-ce67179401a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:35Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Creating volume 2b86e8f4-36ba-41af-a6ff-ce67179401a8 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:35 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:35 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 1073741824 Nov 04 19:17:35 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:35 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 1073741824" returned: 0 in 0.549s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:35 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 Nov 04 19:17:35 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:36 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8" returned: 0 in 0.287s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea436e-e25a-40b5-a6d2-9d6205af1a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50475df3-c5ee-4197-bade-20f593b57af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:36 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Volume volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 (2b86e8f4-36ba-41af-a6ff-ce67179401a8): created successfully Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50475df3-c5ee-4197-bade-20f593b57af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:36 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (5bed0b28-6fa2-4dbd-861a-e23eb225536c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3c5d695e-1e34-4320-b7a5-39305009900e tempest-VolumesListTestJSON-1533558735 None] Created volume successfully. Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (af85f54f-7b40-4ccf-bca3-60ae45402921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689151b1-2268-4ed9-a7aa-30cce1ebbe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689151b1-2268-4ed9-a7aa-30cce1ebbe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1581733107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4baafc8-6131-4d22-ba86-dde3add92ddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:38Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4c3ac4-b66f-43c2-bad8-e8bb53cdb295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4c3ac4-b66f-43c2-bad8-e8bb53cdb295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bb0a58-23d7-4106-a1ad-65a548a19f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bb0a58-23d7-4106-a1ad-65a548a19f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4baafc8-6131-4d22-ba86-dde3add92ddc', 'volume_name': 'volume-e4baafc8-6131-4d22-ba86-dde3add92ddc', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5d2143-2188-458e-9c26-024112844927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5d2143-2188-458e-9c26-024112844927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e421a8-d061-4414-b4a3-aa8968783307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:38 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Volume e4baafc8-6131-4d22-ba86-dde3add92ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4baafc8-6131-4d22-ba86-dde3add92ddc', 'volume_size': 1} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1581733107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4baafc8-6131-4d22-ba86-dde3add92ddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:38Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Creating volume e4baafc8-6131-4d22-ba86-dde3add92ddc {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:38 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:38 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc 1073741824 Nov 04 19:17:38 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:38 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc 1073741824" returned: 0 in 0.590s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:38 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc Nov 04 19:17:38 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:39 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e421a8-d061-4414-b4a3-aa8968783307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4baafc8-6131-4d22-ba86-dde3add92ddc', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282251f0-3e94-4890-adc5-7e20565b0025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Volume volume-e4baafc8-6131-4d22-ba86-dde3add92ddc (e4baafc8-6131-4d22-ba86-dde3add92ddc): created successfully Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282251f0-3e94-4890-adc5-7e20565b0025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (af85f54f-7b40-4ccf-bca3-60ae45402921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c0384e5c-1242-47b2-8dbe-f7d30ea9a2b8 tempest-VolumesListTestJSON-1533558735 None] Created volume successfully. Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (09a5d0ed-63be-4bde-94dc-380240c1c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23d69c-aee8-4c70-95f8-255c36ba027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b23d69c-aee8-4c70-95f8-255c36ba027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-947897208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f5cc9-44d6-499d-8b74-7defcbefb7c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:41Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a43004-dad4-4331-a384-5007f6cd6ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a43004-dad4-4331-a384-5007f6cd6ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d3692-a1dd-4996-a6e3-fb15636e1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d3692-a1dd-4996-a6e3-fb15636e1be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6f5cc9-44d6-499d-8b74-7defcbefb7c6', 'volume_name': 'volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f104ea8-d739-4e50-a28c-411046771aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f104ea8-d739-4e50-a28c-411046771aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428e806d-8483-48d5-a964-4a91eb38bb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:40 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Volume bf6f5cc9-44d6-499d-8b74-7defcbefb7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6', 'volume_size': 1} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-947897208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f5cc9-44d6-499d-8b74-7defcbefb7c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc75a925fe1c4c85bbbf52166a82e4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:41Z,use_quota=True,user_id='7f9e8c6d9fae49d6b5852c6341023d70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Creating volume bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:40 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:40 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 1073741824 Nov 04 19:17:40 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:41 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 1073741824" returned: 0 in 0.542s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:41 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 Nov 04 19:17:41 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:41 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428e806d-8483-48d5-a964-4a91eb38bb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8432a1bf-52c7-486d-bd66-5c28c91d6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:41 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Volume volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 (bf6f5cc9-44d6-499d-8b74-7defcbefb7c6): created successfully Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8432a1bf-52c7-486d-bd66-5c28c91d6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Flow 'volume_create_manager' (09a5d0ed-63be-4bde-94dc-380240c1c915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4c9d7dbc-184d-4482-a237-b8b5e6840d88 tempest-VolumesListTestJSON-1533558735 None] Created volume successfully. Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-quobyte-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0d533-d146-42d3-8b5f-00160171546f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:45 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 Nov 04 19:17:45 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:45 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" returned: 0 in 0.421s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:45 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6 Nov 04 19:17:45 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:45 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6" released by "delete_volume" :: held 0.746s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Created reservations ['a5a280ba-bb44-4e4a-84c0-270ceaa4e441', 'd3cae112-b97e-4eb4-9b32-c8cdd7ac8d46', '6b97583c-4e4d-47bc-a51c-55ab3867db43', '6aeda640-8504-43a3-b65a-1832e0ea041b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:45 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:45 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-e4baafc8-6131-4d22-ba86-dde3add92ddc-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:46 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.273s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-e4baafc8-6131-4d22-ba86-dde3add92ddc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Deleted volume successfully. Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4654fdb0-9ba7-4b03-8b02-5dc0074a1e97 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-bf6f5cc9-44d6-499d-8b74-7defcbefb7c6-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-quobyte-e4baafc8-6131-4d22-ba86-dde3add92ddc" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-e4baafc8-6131-4d22-ba86-dde3add92ddc" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Flow 'volume_create_manager' (df290662-e185-4dd8-98c9-132017156a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e094e0e-18f6-4db9-9199-1ccc57ee222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6614a5e-3df8-4189-8817-5f491d752c8e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e094e0e-18f6-4db9-9199-1ccc57ee222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5990259e-900f-49b9-8602-6d7180bf4632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dea6481f4a44f9b0429c7991425580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:46Z,use_quota=True,user_id='a6e7960e84cc4e9595fddc7a1bed4476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b744d06-b354-42e2-aebf-564c40cf5d19),volume_type_id=8b744d06-b354-42e2-aebf-564c40cf5d19)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65e3c52-4a93-48ad-a91c-2358f14dc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65e3c52-4a93-48ad-a91c-2358f14dc55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40de0451-c616-43f8-9a91-35793869ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:17:46 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc Nov 04 19:17:46 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40de0451-c616-43f8-9a91-35793869ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5990259e-900f-49b9-8602-6d7180bf4632', 'volume_name': 'volume-5990259e-900f-49b9-8602-6d7180bf4632', 'volume_size': 1, 'image_id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20d3355cc8b1cf36b52fc32a5d4a1b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6dea6481f4a44f9b0429c7991425580', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce69b1e08f3b28b60aef175b27334625c8a7069abc93623585d79ff297d7e24a194a53d0ab0463e1ea785eba9cddb4b2603231417f7e28e6758a9b5c7c02d903', 'id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'created_at': datetime.datetime(2026, 11, 4, 18, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d73855d-5d91-41a6-97d3-949f0c550820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d73855d-5d91-41a6-97d3-949f0c550820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a19600f-c45c-4c6b-85ca-67575efffe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Volume 5990259e-900f-49b9-8602-6d7180bf4632: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5990259e-900f-49b9-8602-6d7180bf4632', 'volume_size': 1, 'image_id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20d3355cc8b1cf36b52fc32a5d4a1b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6dea6481f4a44f9b0429c7991425580', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce69b1e08f3b28b60aef175b27334625c8a7069abc93623585d79ff297d7e24a194a53d0ab0463e1ea785eba9cddb4b2603231417f7e28e6758a9b5c7c02d903', 'id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'created_at': datetime.datetime(2026, 11, 4, 18, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Trying to clone 5990259e-900f-49b9-8602-6d7180bf4632 from image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:17:46 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:17:46 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc" returned: 0 in 0.409s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:46 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc Nov 04 19:17:46 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83d4cb4-e59b-4fd9-b48c-99c227e0c624]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:46 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:46 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:46 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e4baafc8-6131-4d22-ba86-dde3add92ddc" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-e4baafc8-6131-4d22-ba86-dde3add92ddc" released by "delete_volume" :: held 0.733s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Created reservations ['5ce8b49f-cc98-4766-8421-c03416840b68', 'ce8ef645-d1b3-43a6-be6e-876014a28912', 'aab26ea9-0877-4d14-857b-f5e838ef3793', 'ac82aef5-e7c4-4578-b83c-2d6a50c34aa6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:46 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:47 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:47 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:47 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:47 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Deleted volume successfully. Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-2b86e8f4-36ba-41af-a6ff-ce67179401a8-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1a5eb4d7-f003-4f2d-b8e2-0b6e80fd8c64 tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-e4baafc8-6131-4d22-ba86-dde3add92ddc-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-2b86e8f4-36ba-41af-a6ff-ce67179401a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:47 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Temporary image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 is fetched for user a6e7960e84cc4e9595fddc7a1bed4476. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "cinder-quobyte-2b86e8f4-36ba-41af-a6ff-ce67179401a8" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-2b86e8f4-36ba-41af-a6ff-ce67179401a8" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b018983f-c4b2-4c2b-b4da-2da86bc042bd]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da6f7bf-a7c4-4666-a352-53c349b59e31]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 Nov 04 19:17:47 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:47 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:47 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:47 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8" returned: 0 in 0.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:47 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8 Nov 04 19:17:47 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:47 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:47 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:48 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2b86e8f4-36ba-41af-a6ff-ce67179401a8" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-quobyte-2b86e8f4-36ba-41af-a6ff-ce67179401a8" released by "delete_volume" :: held 0.711s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:48 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5990259e-900f-49b9-8602-6d7180bf4632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dea6481f4a44f9b0429c7991425580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:17:46Z,use_quota=True,user_id='a6e7960e84cc4e9595fddc7a1bed4476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b744d06-b354-42e2-aebf-564c40cf5d19),volume_type_id=8b744d06-b354-42e2-aebf-564c40cf5d19)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Creating volume 5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:17:48 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:48 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1073741824 Nov 04 19:17:48 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Created reservations ['b5138d51-3977-469b-96eb-a5db14b00a07', '195750c2-689e-46be-a3f5-390f440997fa', 'f27a4e05-e649-45c4-9371-55a18d6254b9', '0978945a-c0f2-4f19-8089-d408be3a59f4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:48 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:48 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:48 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Deleted volume successfully. Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-69ed3435-6c39-4b18-be1b-e21ae6b9ee7e tempest-VolumesListTestJSON-1533558735 None] Lock "cinder-2b86e8f4-36ba-41af-a6ff-ce67179401a8-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:48 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1073741824" returned: 0 in 0.482s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:48 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 Nov 04 19:17:48 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:48 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:48 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Attempting download of 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}])) to volume 5990259e-900f-49b9-8602-6d7180bf4632. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc7ffd6-717d-4f00-b16d-d250265ecefe]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:49 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12 Nov 04 19:17:49 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:49 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12" returned: 0 in 0.355s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:49 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12 Nov 04 19:17:49 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:49 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12" returned: 1 in 0.340s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_2hdhgh12' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc019105-cfa4-4d1e-a64c-1660d3787210]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:49 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:49 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:50 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:50 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD Nov 04 19:17:50 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:50 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 was raw, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:50 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 Nov 04 19:17:50 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:50 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632" returned: 0 in 0.479s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dfc64c7-94ae-4c4e-a2af-8717643b97e5_o55a0emsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:17:50 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:17:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:50 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1G Nov 04 19:17:50 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:51 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 1G" returned: 0 in 0.331s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Downloaded image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}])) to volume 5990259e-900f-49b9-8602-6d7180bf4632 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Temporary image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 for user a6e7960e84cc4e9595fddc7a1bed4476 is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Marking volume 5990259e-900f-49b9-8602-6d7180bf4632 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Copying metadata from image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 to 5990259e-900f-49b9-8602-6d7180bf4632. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Creating volume glance metadata for volume 5990259e-900f-49b9-8602-6d7180bf4632 backed by image 8dfc64c7-94ae-4c4e-a2af-8717643b97e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c20d3355cc8b1cf36b52fc32a5d4a1b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a19600f-c45c-4c6b-85ca-67575efffe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5990259e-900f-49b9-8602-6d7180bf4632', 'volume_size': 1, 'image_id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c20d3355cc8b1cf36b52fc32a5d4a1b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6dea6481f4a44f9b0429c7991425580', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce69b1e08f3b28b60aef175b27334625c8a7069abc93623585d79ff297d7e24a194a53d0ab0463e1ea785eba9cddb4b2603231417f7e28e6758a9b5c7c02d903', 'id': '8dfc64c7-94ae-4c4e-a2af-8717643b97e5', 'created_at': datetime.datetime(2026, 11, 4, 18, 17, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 17, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dfc64c7-94ae-4c4e-a2af-8717643b97e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c18dec-2457-46f8-904b-c9030fa962db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:17:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Volume volume-5990259e-900f-49b9-8602-6d7180bf4632 (5990259e-900f-49b9-8602-6d7180bf4632): created successfully Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c18dec-2457-46f8-904b-c9030fa962db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:17:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Flow 'volume_create_manager' (df290662-e185-4dd8-98c9-132017156a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:17:51 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f0f83673-24ca-4bbc-b496-a7bc6b36fd93 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Created volume successfully. Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Acquiring lock "cinder-5990259e-900f-49b9-8602-6d7180bf4632-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "cinder-5990259e-900f-49b9-8602-6d7180bf4632-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Acquiring lock "cinder-quobyte-5990259e-900f-49b9-8602-6d7180bf4632" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "cinder-quobyte-5990259e-900f-49b9-8602-6d7180bf4632" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410e8ff-1b8e-496c-aa44-74edeea6ec8a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:17:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:52 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 Nov 04 19:17:52 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:53 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632" returned: 0 in 0.382s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:53 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632 Nov 04 19:17:53 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:53 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5990259e-900f-49b9-8602-6d7180bf4632" returned: 0 in 0.285s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "cinder-quobyte-5990259e-900f-49b9-8602-6d7180bf4632" released by "delete_volume" :: held 0.718s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:17:53 devstack cinder-volume[87367]: WARNING cinder.quota [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:17:53 devstack cinder-volume[87367]: WARNING cinder.quota [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Created reservations ['f2c87fbe-a7fb-4ff4-b865-92976d860f2e', '73a218b6-2d21-4d02-8641-edf4b8d60916', '4e651a97-0304-4e5c-ae0a-cb143d5d0396', 'f9f37287-0edb-4f76-bc47-c26254a093e5'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:17:53 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:17:53 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:17:53 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.295s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:17:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Deleted volume successfully. Nov 04 19:17:53 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fc1e671d-1aa6-47a5-a7f2-5fe64a5f9a11 tempest-VolumeAndVolumeTypeFromImageTest-613199156 None] Lock "cinder-5990259e-900f-49b9-8602-6d7180bf4632-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=76,cinder:UPDATE=124,cinder:DELETE=10,cinder:INSERT=28 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (4fb216a1-85da-4029-859a-2bc4fd5dd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c5d415-fdb0-4986-86a5-1f05a6afed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c5d415-fdb0-4986-86a5-1f05a6afed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1933964084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3f259-5052-4500-b626-5b4c4f034f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:04Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b535bc2-553e-4aba-9818-08a2a3f80b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b535bc2-553e-4aba-9818-08a2a3f80b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b8c547-72ae-4a28-a563-d7a6b96082ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b8c547-72ae-4a28-a563-d7a6b96082ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d3f259-5052-4500-b626-5b4c4f034f3b', 'volume_name': 'volume-64d3f259-5052-4500-b626-5b4c4f034f3b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93b19c-2bca-4f7c-9ce2-7dfbfacc8ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa93b19c-2bca-4f7c-9ce2-7dfbfacc8ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6eb786-67bc-4830-b267-b5c037030597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:03 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Volume 64d3f259-5052-4500-b626-5b4c4f034f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d3f259-5052-4500-b626-5b4c4f034f3b', 'volume_size': 1} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1933964084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3f259-5052-4500-b626-5b4c4f034f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:04Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Creating volume 64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:03 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:03 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b 1073741824 Nov 04 19:18:03 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:04 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b 1073741824" returned: 0 in 0.426s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:04 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b Nov 04 19:18:04 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:04 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6eb786-67bc-4830-b267-b5c037030597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d3f259-5052-4500-b626-5b4c4f034f3b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db140bde-9b9e-4883-a8c3-139e6b12bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Volume volume-64d3f259-5052-4500-b626-5b4c4f034f3b (64d3f259-5052-4500-b626-5b4c4f034f3b): created successfully Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db140bde-9b9e-4883-a8c3-139e6b12bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (4fb216a1-85da-4029-859a-2bc4fd5dd943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-84a71acc-ee59-42b9-acc0-933a727598e3 tempest-VolumesSnapshotTestJSON-220308728 None] Created volume successfully. Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Creating offline snapshot 7fb157bd-0e7c-437f-990a-4a92ad513718 of volume 64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32edad1-dd0b-4497-afa0-0cb910802ed7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:05 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b Nov 04 19:18:05 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:05 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:05 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 1G Nov 04 19:18:05 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:05 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 1G" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3f259-5052-4500-b626-5b4c4f034f3b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:05 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3f259-5052-4500-b626-5b4c4f034f3b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 Nov 04 19:18:05 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:05 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d3f259-5052-4500-b626-5b4c4f034f3b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:05 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 is being set with open permissions: ugo+rw Nov 04 19:18:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:05 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 Nov 04 19:18:06 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:06 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718" returned: 0 in 0.240s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:06 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info Nov 04 19:18:06 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:06 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:06 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info is being set with open permissions: ugo+rw Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:06 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info Nov 04 19:18:06 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:06 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.info" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c2ff1366-bdc0-4b60-85a3-715da55dde51 tempest-VolumesSnapshotTestJSON-220308728 None] Create snapshot completed successfully Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-7fb157bd-0e7c-437f-990a-4a92ad513718-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-7fb157bd-0e7c-437f-990a-4a92ad513718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-7fb157bd-0e7c-437f-990a-4a92ad513718" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-7fb157bd-0e7c-437f-990a-4a92ad513718" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Deleting offline snapshot 7fb157bd-0e7c-437f-990a-4a92ad513718 of volume 64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] snapshot_file for this snap is: volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1390b-0989-4223-8ac7-434e5a1cb34e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:07 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 Nov 04 19:18:07 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:07 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64d3f259-5052-4500-b626-5b4c4f034f3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cca037-08da-4ae9-81af-1a3cab59715c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:07 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b Nov 04 19:18:07 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:07 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b" returned: 0 in 0.355s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:08 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 Nov 04 19:18:08 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:08 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718" returned: 0 in 0.327s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:08 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718 Nov 04 19:18:08 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:08 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b.7fb157bd-0e7c-437f-990a-4a92ad513718" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-7fb157bd-0e7c-437f-990a-4a92ad513718" released by "_delete_snapshot" :: held 1.397s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" released by "delete_snapshot" :: held 1.419s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['4f8360c6-1d9f-454d-bf5f-4d1a81bb9654', 'ffdfda0f-514b-494c-9be7-40b58fc35011', 'ec6221ed-3887-4636-b816-1ff7136d9193', 'ba07ac80-cb6f-4064-b81e-f61162fc2578'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Delete snapshot completed successfully. Nov 04 19:18:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d406fddb-2fe6-4c55-acde-a459c21761a1 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-7fb157bd-0e7c-437f-990a-4a92ad513718-delete_snapshot" released by "delete_snapshot" :: held 1.574s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (8b793e58-1793-49ad-809d-9d660e977162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3f1c14-fbb7-4d47-b2ea-b148fbc0e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3f1c14-fbb7-4d47-b2ea-b148fbc0e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610279047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9c4709-3d20-4e1d-93b4-3485b35979de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:10Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaad8d4-e625-4288-9e16-2a9b0b2a12c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaad8d4-e625-4288-9e16-2a9b0b2a12c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575afbf0-b86e-4f1d-a8fe-5a9e97bd8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575afbf0-b86e-4f1d-a8fe-5a9e97bd8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9c4709-3d20-4e1d-93b4-3485b35979de', 'volume_name': 'volume-8b9c4709-3d20-4e1d-93b4-3485b35979de', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34b3ea-015c-40cf-840b-0d37f69cba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d34b3ea-015c-40cf-840b-0d37f69cba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1b810-ee90-4594-a531-e8ed69a83450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Volume 8b9c4709-3d20-4e1d-93b4-3485b35979de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9c4709-3d20-4e1d-93b4-3485b35979de', 'volume_size': 1} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-610279047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9c4709-3d20-4e1d-93b4-3485b35979de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:10Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Creating volume 8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:09 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:09 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de 1073741824 Nov 04 19:18:09 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:10 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de 1073741824" returned: 0 in 0.421s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:10 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:10 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:10 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec1b810-ee90-4594-a531-e8ed69a83450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9c4709-3d20-4e1d-93b4-3485b35979de', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78923220-8372-4859-afcb-f9e3ed75c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Volume volume-8b9c4709-3d20-4e1d-93b4-3485b35979de (8b9c4709-3d20-4e1d-93b4-3485b35979de): created successfully Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78923220-8372-4859-afcb-f9e3ed75c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (8b793e58-1793-49ad-809d-9d660e977162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-64795beb-5468-43a0-af6b-04e1b9a79bac tempest-VolumesSnapshotTestJSON-220308728 None] Created volume successfully. Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Creating offline snapshot 81bdf14e-e10e-4d5c-8ee9-eac43579aea6 of volume 8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f030d897-a564-483c-a89e-08752cd41c21]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:11 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:11 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:11 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:11 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 1G Nov 04 19:18:11 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:11 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 1G" returned: 0 in 0.411s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9c4709-3d20-4e1d-93b4-3485b35979de -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:11 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9c4709-3d20-4e1d-93b4-3485b35979de -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:11 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:12 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9c4709-3d20-4e1d-93b4-3485b35979de -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:12 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 is being set with open permissions: ugo+rw Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:12 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:12 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:12 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:12 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info Nov 04 19:18:12 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:12 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:12 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info is being set with open permissions: ugo+rw Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:12 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info Nov 04 19:18:12 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:12 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.info" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5db0ec96-c798-4aeb-be0c-0da0683791eb tempest-VolumesSnapshotTestJSON-220308728 None] Create snapshot completed successfully Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (8a988896-3691-432d-a6cd-1f6204809f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6d339c-64e6-4e40-b108-33cbe3b59569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6d339c-64e6-4e40-b108-33cbe3b59569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1112689691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5abef6-8da9-4dd8-b3a0-379db00b7688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=81bdf14e-e10e-4d5c-8ee9-eac43579aea6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:14Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5da56b6-feac-4eed-abc9-2ced6327c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5da56b6-feac-4eed-abc9-2ced6327c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58795f72-965b-413f-8f8e-99f8053945fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58795f72-965b-413f-8f8e-99f8053945fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c5abef6-8da9-4dd8-b3a0-379db00b7688', 'volume_name': 'volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688', 'volume_size': 2, 'snapshot_id': '81bdf14e-e10e-4d5c-8ee9-eac43579aea6'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d63ddb7-e9cd-40a1-a388-69bd26420fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d63ddb7-e9cd-40a1-a388-69bd26420fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a36d73-48ed-4343-95b0-0e2b376c10c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Volume 8c5abef6-8da9-4dd8-b3a0-379db00b7688: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688', 'volume_size': 2, 'snapshot_id': '81bdf14e-e10e-4d5c-8ee9-eac43579aea6'} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-8c5abef6-8da9-4dd8-b3a0-379db00b7688" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-8c5abef6-8da9-4dd8-b3a0-379db00b7688" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Creating volume 8c5abef6-8da9-4dd8-b3a0-379db00b7688 from snapshot 81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] snapshot: 81bdf14e-e10e-4d5c-8ee9-eac43579aea6, volume: 8c5abef6-8da9-4dd8-b3a0-379db00b7688, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b5c36-39bb-4c95-9b47-b978298ba1d6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:13 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:13 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:14 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b9c4709-3d20-4e1d-93b4-3485b35979de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c14f9-4a62-42b1-bcaf-68e7642ebf99]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:14 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:14 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:14 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:18:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:14 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 Nov 04 19:18:14 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:20 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688" returned: 0 in 5.896s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:18:20 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Converted 1024.00 MB image at 173.63 MB/s Nov 04 19:18:20 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 is being set with open permissions: ugo+rw Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:20 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 Nov 04 19:18:20 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:20 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" released by "_copy_volume_from_snapshot" :: held 6.937s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=102,cinder:UPDATE=128,cinder:INSERT=41,cinder:DELETE=11 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-8c5abef6-8da9-4dd8-b3a0-379db00b7688" released by "_create_volume_from_snapshot" :: held 7.001s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a36d73-48ed-4343-95b0-0e2b376c10c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688', 'volume_size': 2, 'snapshot_id': '81bdf14e-e10e-4d5c-8ee9-eac43579aea6'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52524716-5902-49c4-8ef0-71ce8cc9d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Volume volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 (8c5abef6-8da9-4dd8-b3a0-379db00b7688): created successfully Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52524716-5902-49c4-8ef0-71ce8cc9d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (8a988896-3691-432d-a6cd-1f6204809f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e6675774-4a92-4f96-bb9c-dec66befad39 tempest-VolumesSnapshotTestJSON-220308728 None] Created volume successfully. Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-8c5abef6-8da9-4dd8-b3a0-379db00b7688-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-8c5abef6-8da9-4dd8-b3a0-379db00b7688-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b4fb7b-4a95-4180-9174-16a44d92d3a1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:21 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 Nov 04 19:18:21 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:21 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:21 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688 Nov 04 19:18:21 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:21 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c5abef6-8da9-4dd8-b3a0-379db00b7688" returned: 0 in 0.244s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8c5abef6-8da9-4dd8-b3a0-379db00b7688" released by "delete_volume" :: held 0.657s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['a7395faf-60bc-491f-ac8c-9826653b4496', '4dddd736-5d25-47a6-9aae-7d040b61563f', 'f1a12706-2479-43a2-90ce-5c0ec22cf281', '2f6a0f55-5682-46e9-86e6-db866b128e34'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:22 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:22 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:22 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:22 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:22 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Deleted volume successfully. Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-66227779-0cbc-469d-bace-8b4011e491de tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-8c5abef6-8da9-4dd8-b3a0-379db00b7688-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:22 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Deleting offline snapshot 81bdf14e-e10e-4d5c-8ee9-eac43579aea6 of volume 8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] snapshot_file for this snap is: volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f755cca-54dd-4837-a9b8-40575b20c893]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:22 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:22 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:22 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b9c4709-3d20-4e1d-93b4-3485b35979de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de58ac-d720-4ce5-ae0b-6433ff35020d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:23 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:23 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:23 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.535s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:23 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:23 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:23 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.323s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:23 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6 Nov 04 19:18:23 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:24 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de.81bdf14e-e10e-4d5c-8ee9-eac43579aea6" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-81bdf14e-e10e-4d5c-8ee9-eac43579aea6" released by "_delete_snapshot" :: held 1.569s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" released by "delete_snapshot" :: held 1.588s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['5175750a-9c84-4c5e-ad73-6731fda1a584', 'f28278e2-d03b-42b1-9602-281fe348b042', '8153e912-ef7c-4efa-8294-d41df468c9f7', 'fcc4ba84-361d-4e0b-a581-0b80e42610c2'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Delete snapshot completed successfully. Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2a86062b-9c0a-4b0f-b27d-d44ee9892121 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-81bdf14e-e10e-4d5c-8ee9-eac43579aea6-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-8b9c4709-3d20-4e1d-93b4-3485b35979de-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-8b9c4709-3d20-4e1d-93b4-3485b35979de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[471aa0ce-8a39-4678-a4c7-cd7323f6e694]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:24 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:24 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:25 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.369s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:25 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de Nov 04 19:18:25 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:25 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8b9c4709-3d20-4e1d-93b4-3485b35979de" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-8b9c4709-3d20-4e1d-93b4-3485b35979de" released by "delete_volume" :: held 0.680s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['e55a94e5-4531-4bab-bbdb-aafe18742e99', '8ce811ff-1caf-4933-b3c3-ebfd647c9028', 'c61d68d1-eea0-4c09-b3e4-a2c43dd269f9', 'fa3eb469-8f31-4270-98c5-62563e8e5dbd'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:25 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:25 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:25 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Deleted volume successfully. Nov 04 19:18:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5e096982-7afa-47c6-8362-7e5bdd63beca tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-8b9c4709-3d20-4e1d-93b4-3485b35979de-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (5d0344e7-f298-4609-9fed-06c3490def6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c036f0e-2ad3-421e-b2d9-927156c7e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c036f0e-2ad3-421e-b2d9-927156c7e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605366303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544e88c7-8636-4271-b9c1-aa7f5ff83428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:26Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c03d1-8edf-4c60-9b20-1b1f0f34fb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040c03d1-8edf-4c60-9b20-1b1f0f34fb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed3d32-3701-4bb4-9e5b-0f2b7904ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed3d32-3701-4bb4-9e5b-0f2b7904ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544e88c7-8636-4271-b9c1-aa7f5ff83428', 'volume_name': 'volume-544e88c7-8636-4271-b9c1-aa7f5ff83428', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d50d7c-512d-47de-b3c4-df413f40c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d50d7c-512d-47de-b3c4-df413f40c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae81188-53bd-4321-ab94-0ff3fd7994fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Volume 544e88c7-8636-4271-b9c1-aa7f5ff83428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544e88c7-8636-4271-b9c1-aa7f5ff83428', 'volume_size': 1} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605366303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544e88c7-8636-4271-b9c1-aa7f5ff83428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:26Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Creating volume 544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:26 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:26 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 1073741824 Nov 04 19:18:26 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:26 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 1073741824" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:26 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:26 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:27 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae81188-53bd-4321-ab94-0ff3fd7994fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544e88c7-8636-4271-b9c1-aa7f5ff83428', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c915b242-bc3f-472e-87e8-eb22e37c75c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:27 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Volume volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 (544e88c7-8636-4271-b9c1-aa7f5ff83428): created successfully Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c915b242-bc3f-472e-87e8-eb22e37c75c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (5d0344e7-f298-4609-9fed-06c3490def6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9e9b5cf7-58c8-4937-808b-d2de089af5d6 tempest-VolumesSnapshotTestJSON-220308728 None] Created volume successfully. Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Creating offline snapshot 0f0555a5-7889-41ae-852b-ba5c20c94066 of volume 544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef55da80-e0d6-4ad5-b195-7ffb2240c889]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:27 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:27 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:27 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:27 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 1G Nov 04 19:18:27 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:28 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 1G" returned: 0 in 0.398s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:28 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:28 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:28 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:28 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 is being set with open permissions: ugo+rw Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:28 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:28 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:28 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.237s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:28 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info Nov 04 19:18:28 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:29 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:29 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info is being set with open permissions: ugo+rw Nov 04 19:18:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:29 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info Nov 04 19:18:29 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:29 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.info" returned: 0 in 0.237s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-16e0cbcd-7fcb-4357-a7ab-a2e7e7b0a6ba tempest-VolumesSnapshotTestJSON-220308728 None] Create snapshot completed successfully Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (611c5276-60ec-496a-a153-52c8f67f2b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f9f231-4b31-40af-bb2a-346d8ad12fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f9f231-4b31-40af-bb2a-346d8ad12fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-840465814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b945f6-1c41-4fe2-a3be-c7d2d1372a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e734d0b2084e859c09d91411683c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f0555a5-7889-41ae-852b-ba5c20c94066,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:30Z,use_quota=True,user_id='b95d63132ca14949bc839ebbf8444583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7e7c9c-060a-45bd-9575-c4faaa7e81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7e7c9c-060a-45bd-9575-c4faaa7e81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f1af86-aa53-4b8a-8928-3be41b07b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f1af86-aa53-4b8a-8928-3be41b07b4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06b945f6-1c41-4fe2-a3be-c7d2d1372a75', 'volume_name': 'volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75', 'volume_size': 1, 'snapshot_id': '0f0555a5-7889-41ae-852b-ba5c20c94066'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397182a6-a8ec-4240-a79c-0217176f9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397182a6-a8ec-4240-a79c-0217176f9824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85011396-ea7c-4fb4-9c04-f8765b1dca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Volume 06b945f6-1c41-4fe2-a3be-c7d2d1372a75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75', 'volume_size': 1, 'snapshot_id': '0f0555a5-7889-41ae-852b-ba5c20c94066'} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Creating volume 06b945f6-1c41-4fe2-a3be-c7d2d1372a75 from snapshot 0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] snapshot: 0f0555a5-7889-41ae-852b-ba5c20c94066, volume: 06b945f6-1c41-4fe2-a3be-c7d2d1372a75, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95cea4-73fa-4868-8ffb-78d2e6cac051]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:30 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:30 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:30 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.365s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544e88c7-8636-4271-b9c1-aa7f5ff83428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4b90cd-6e11-4233-866d-93e607826ac9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:30 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:30 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:31 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:18:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:18:31 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:18:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:31 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 Nov 04 19:18:31 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:37 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" returned: 0 in 5.991s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:18:37 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Converted 1024.00 MB image at 170.90 MB/s Nov 04 19:18:37 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 is being set with open permissions: ugo+rw Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:37 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 Nov 04 19:18:37 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:37 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" returned: 0 in 0.240s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" released by "_copy_volume_from_snapshot" :: held 7.046s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" released by "_create_volume_from_snapshot" :: held 7.107s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.124s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85011396-ea7c-4fb4-9c04-f8765b1dca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75', 'volume_size': 1, 'snapshot_id': '0f0555a5-7889-41ae-852b-ba5c20c94066'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c5aa01-1b4d-4684-9f8d-af2469353f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:37 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Volume volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 (06b945f6-1c41-4fe2-a3be-c7d2d1372a75): created successfully Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c5aa01-1b4d-4684-9f8d-af2469353f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Flow 'volume_create_manager' (611c5276-60ec-496a-a153-52c8f67f2b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:37 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-bfcffd34-927d-4b94-bfc9-afc956b23cb0 tempest-VolumesSnapshotTestJSON-220308728 None] Created volume successfully. Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-06b945f6-1c41-4fe2-a3be-c7d2d1372a75-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-06b945f6-1c41-4fe2-a3be-c7d2d1372a75-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f771e19-f45e-434b-8f6c-55be3e7da68b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:37 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 Nov 04 19:18:37 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:38 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" returned: 0 in 0.348s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:38 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75 Nov 04 19:18:38 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:38 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-06b945f6-1c41-4fe2-a3be-c7d2d1372a75" released by "delete_volume" :: held 0.625s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['be7656df-77c7-4a67-8499-e1763b4e34e3', '720f92ba-d027-4f84-82a4-425d2191b50f', '0b66b256-5aec-4722-bb51-1ca29a7fe69a', '65565b29-37a7-4716-b29c-2f7cbfd7e872'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:38 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:38 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:38 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Deleted volume successfully. Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6e355048-8263-4344-8cbc-1c91c7271523 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-06b945f6-1c41-4fe2-a3be-c7d2d1372a75-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-0f0555a5-7889-41ae-852b-ba5c20c94066-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-0f0555a5-7889-41ae-852b-ba5c20c94066-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Deleting offline snapshot 0f0555a5-7889-41ae-852b-ba5c20c94066 of volume 544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] snapshot_file for this snap is: volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a500039f-a055-4667-943d-6140549cb0f0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:39 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:39 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:39 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544e88c7-8636-4271-b9c1-aa7f5ff83428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb3e266-af8d-4cb6-b935-a459b510f2c8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:39 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:39 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:39 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.545s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:39 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:39 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:40 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.324s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:40 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066 Nov 04 19:18:40 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:40 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428.0f0555a5-7889-41ae-852b-ba5c20c94066" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-0f0555a5-7889-41ae-852b-ba5c20c94066" released by "_delete_snapshot" :: held 1.570s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" released by "delete_snapshot" :: held 1.590s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['55fc4d46-2820-4890-9a62-a2e10ddc7afa', 'c8e469d1-187f-463b-a30a-18c9745811ee', 'b649a3b3-31c7-4892-b7a3-08d100b48703', 'dd824aaa-fec3-4949-8c65-23e8dd71fef4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Delete snapshot completed successfully. Nov 04 19:18:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b606a8b6-42f5-4b8c-a6b3-a8d5f85f7e23 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-0f0555a5-7889-41ae-852b-ba5c20c94066-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-544e88c7-8636-4271-b9c1-aa7f5ff83428-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-544e88c7-8636-4271-b9c1-aa7f5ff83428-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc9cdc3-e961-45b9-b8ed-882bada4f142]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:41 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:41 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:41 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:41 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428 Nov 04 19:18:41 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:41 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-544e88c7-8636-4271-b9c1-aa7f5ff83428" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-544e88c7-8636-4271-b9c1-aa7f5ff83428" released by "delete_volume" :: held 0.661s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['d62c4bfc-08e1-4e7b-99f4-265b5fbcc23a', 'd1ff7a4d-824b-4497-9d77-feba36c5e2a4', '390d622f-385a-446c-a9cd-f44240618f3d', '48733b92-c6c6-456d-bb42-8eb738b44ae6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:41 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:41 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:42 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.236s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:42 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Deleted volume successfully. Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b5276612-cb7a-4a4b-b470-0e265a5131e7 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-544e88c7-8636-4271-b9c1-aa7f5ff83428-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-64d3f259-5052-4500-b626-5b4c4f034f3b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-64d3f259-5052-4500-b626-5b4c4f034f3b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e5edb-7b25-4e2f-b31c-eb5ce6ae1f4f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:42 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b Nov 04 19:18:42 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:42 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:42 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b Nov 04 19:18:42 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:43 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-64d3f259-5052-4500-b626-5b4c4f034f3b" returned: 0 in 0.241s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-quobyte-64d3f259-5052-4500-b626-5b4c4f034f3b" released by "delete_volume" :: held 0.647s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Created reservations ['f981aebb-53cb-4233-a64a-5d683cab46a3', 'cbf9d06f-6abc-4245-b796-9438bc7a013d', '6c99b5e3-9e68-4b18-b5c1-d613ae986d6c', '20f7dcaf-4abc-4c3d-ba6b-20d4e6ab0ecd'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:43 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:43 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:43 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Deleted volume successfully. Nov 04 19:18:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-56e71aad-a112-453e-9897-8924de7ad3d6 tempest-VolumesSnapshotTestJSON-220308728 None] Lock "cinder-64d3f259-5052-4500-b626-5b4c4f034f3b-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (36b803dd-1de0-47bf-b2bb-7704c2a58a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a259998-b5e4-421e-a649-9e4cd1c0d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a259998-b5e4-421e-a649-9e4cd1c0d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398815158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33474f1-b57e-4697-b575-6c261f23c413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:50Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf3ca6f-234f-4934-bf78-bbb041aa2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf3ca6f-234f-4934-bf78-bbb041aa2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17c188b-c2e8-4761-8492-a3e16d492e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17c188b-c2e8-4761-8492-a3e16d492e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33474f1-b57e-4697-b575-6c261f23c413', 'volume_name': 'volume-f33474f1-b57e-4697-b575-6c261f23c413', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765c9581-a45e-41e7-8105-ad3259bc83c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765c9581-a45e-41e7-8105-ad3259bc83c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0082bf8-0930-4541-9863-747c77874100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Volume f33474f1-b57e-4697-b575-6c261f23c413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33474f1-b57e-4697-b575-6c261f23c413', 'volume_size': 1} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398815158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33474f1-b57e-4697-b575-6c261f23c413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:50Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Creating volume f33474f1-b57e-4697-b575-6c261f23c413 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:50 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:50 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 1073741824 Nov 04 19:18:50 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (68575a97-5e2d-488c-b3e2-1ca7c9b6983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6d4097-e810-41f0-a1aa-0ba73430dae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6d4097-e810-41f0-a1aa-0ba73430dae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152112376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50468682-c2eb-4524-8052-2f90d4e3e014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:50Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6195e486-ff59-494e-84a1-fc8e63fc8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6195e486-ff59-494e-84a1-fc8e63fc8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d9ca2e-fb14-42b7-a6d4-3129e808f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d9ca2e-fb14-42b7-a6d4-3129e808f31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50468682-c2eb-4524-8052-2f90d4e3e014', 'volume_name': 'volume-50468682-c2eb-4524-8052-2f90d4e3e014', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e91054-beac-4d28-80c6-903b51389c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e91054-beac-4d28-80c6-903b51389c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ae684-f379-41e6-b857-f571eafd259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Volume 50468682-c2eb-4524-8052-2f90d4e3e014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50468682-c2eb-4524-8052-2f90d4e3e014', 'volume_size': 1} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:50 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 1073741824" returned: 0 in 0.503s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:50 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 Nov 04 19:18:50 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (5fd203c2-082b-4ea0-8d99-1970369280cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d56532a-5efd-497b-9da1-d4dcd44d19a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d56532a-5efd-497b-9da1-d4dcd44d19a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509023851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18cffb6-84ec-4227-b7b5-4e679f213b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704b32b-ca4d-4ddf-b0c3-66392973c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704b32b-ca4d-4ddf-b0c3-66392973c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2c8b9-e15a-477a-b4f7-03758b84845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d2c8b9-e15a-477a-b4f7-03758b84845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18cffb6-84ec-4227-b7b5-4e679f213b6f', 'volume_name': 'volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981eb19-9ec9-4f18-9267-fbd7f87d8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981eb19-9ec9-4f18-9267-fbd7f87d8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee0e6ce-b491-444c-a700-80b2d35c244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:50 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Volume d18cffb6-84ec-4227-b7b5-4e679f213b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f', 'volume_size': 1} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:50 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413" returned: 0 in 0.280s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152112376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50468682-c2eb-4524-8052-2f90d4e3e014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:50Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Creating volume 50468682-c2eb-4524-8052-2f90d4e3e014 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:50 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0082bf8-0930-4541-9863-747c77874100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33474f1-b57e-4697-b575-6c261f23c413', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535c793d-3a7f-4bbe-b379-71b7002c9e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 1073741824 Nov 04 19:18:51 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Volume volume-f33474f1-b57e-4697-b575-6c261f23c413 (f33474f1-b57e-4697-b575-6c261f23c413): created successfully Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535c793d-3a7f-4bbe-b379-71b7002c9e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (36b803dd-1de0-47bf-b2bb-7704c2a58a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0f47733a-f1ac-4071-97dd-e4cf45b46e43 tempest-CreateVolumesFromImageTest-809537760 None] Created volume successfully. Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (122c88fd-e3bd-4b80-8390-e3af2cfc80e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a7f730-d54b-48cd-b0a2-2d0846a9bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a7f730-d54b-48cd-b0a2-2d0846a9bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1414332752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758ae7d-0214-43f5-b1ff-d0ee99da47f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac039aa8-6af4-46c7-8994-23b80be235f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac039aa8-6af4-46c7-8994-23b80be235f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efcc19f-485c-4767-b71b-f53362ffc418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efcc19f-485c-4767-b71b-f53362ffc418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7758ae7d-0214-43f5-b1ff-d0ee99da47f6', 'volume_name': 'volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c076e77a-78f8-4625-83d4-5fa48cdbc283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c076e77a-78f8-4625-83d4-5fa48cdbc283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8496e6-1883-421b-9509-138295a5b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Volume 7758ae7d-0214-43f5-b1ff-d0ee99da47f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6', 'volume_size': 1} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (be62aac0-1360-44b7-aa9b-153091008e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:51 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c9a989-6381-4edd-9933-034300f541eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 1073741824" returned: 0 in 0.589s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c9a989-6381-4edd-9933-034300f541eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940244253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c413dfef-9a6d-4b30-831e-c80663765208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdfa217-992b-4207-82ea-dcf9f0bef0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdfa217-992b-4207-82ea-dcf9f0bef0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd04d41-9227-44ac-9e62-6466c12d3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd04d41-9227-44ac-9e62-6466c12d3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c413dfef-9a6d-4b30-831e-c80663765208', 'volume_name': 'volume-c413dfef-9a6d-4b30-831e-c80663765208', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e676c0-b9b1-4761-88d6-5b6d17d04b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e676c0-b9b1-4761-88d6-5b6d17d04b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ecb641-6848-4b0e-b0c6-f932d6e5b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Volume c413dfef-9a6d-4b30-831e-c80663765208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c413dfef-9a6d-4b30-831e-c80663765208', 'volume_size': 1} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:51 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 Nov 04 19:18:51 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:51 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509023851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18cffb6-84ec-4227-b7b5-4e679f213b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Creating volume d18cffb6-84ec-4227-b7b5-4e679f213b6f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8ae684-f379-41e6-b857-f571eafd259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50468682-c2eb-4524-8052-2f90d4e3e014', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f 1073741824 Nov 04 19:18:51 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81caea68-5777-4069-a3e2-78f521504423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Volume volume-50468682-c2eb-4524-8052-2f90d4e3e014 (50468682-c2eb-4524-8052-2f90d4e3e014): created successfully Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81caea68-5777-4069-a3e2-78f521504423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:51 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (68575a97-5e2d-488c-b3e2-1ca7c9b6983b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:51 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-63969d31-c99b-4577-a96c-44583ca4ffc8 tempest-CreateVolumesFromImageTest-809537760 None] Created volume successfully. Nov 04 19:18:52 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f 1073741824" returned: 0 in 0.495s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:52 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f Nov 04 19:18:52 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:52 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1414332752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758ae7d-0214-43f5-b1ff-d0ee99da47f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Creating volume 7758ae7d-0214-43f5-b1ff-d0ee99da47f6 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:52 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:52 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 1073741824 Nov 04 19:18:52 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee0e6ce-b491-444c-a700-80b2d35c244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8d77b3-09f4-415c-84f8-1095736a980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:52 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Volume volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f (d18cffb6-84ec-4227-b7b5-4e679f213b6f): created successfully Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8d77b3-09f4-415c-84f8-1095736a980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (5fd203c2-082b-4ea0-8d99-1970369280cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d7818b6c-b1d8-41e9-a589-48ffd3049e31 tempest-CreateVolumesFromImageTest-809537760 None] Created volume successfully. Nov 04 19:18:53 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 1073741824" returned: 0 in 0.409s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:53 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 Nov 04 19:18:53 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:53 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-940244253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c413dfef-9a6d-4b30-831e-c80663765208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e65f561085e34761b4132a9c03afa274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:18:51Z,use_quota=True,user_id='3cb9ea261c5a49838174a7af943ae0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Creating volume c413dfef-9a6d-4b30-831e-c80663765208 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:18:53 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8496e6-1883-421b-9509-138295a5b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f643689-1b81-4a28-b9fd-4566e8e2544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:53 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 1073741824 Nov 04 19:18:53 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Volume volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 (7758ae7d-0214-43f5-b1ff-d0ee99da47f6): created successfully Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f643689-1b81-4a28-b9fd-4566e8e2544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (122c88fd-e3bd-4b80-8390-e3af2cfc80e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1c7187d2-b1fe-4c97-842d-7a10247e597b tempest-CreateVolumesFromImageTest-809537760 None] Created volume successfully. Nov 04 19:18:53 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 1073741824" returned: 0 in 0.431s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:53 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 Nov 04 19:18:53 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:54 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ecb641-6848-4b0e-b0c6-f932d6e5b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c413dfef-9a6d-4b30-831e-c80663765208', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3096aa-9fce-41f5-9955-2a571e3e75bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:18:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Volume volume-c413dfef-9a6d-4b30-831e-c80663765208 (c413dfef-9a6d-4b30-831e-c80663765208): created successfully Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d3096aa-9fce-41f5-9955-2a571e3e75bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Flow 'volume_create_manager' (be62aac0-1360-44b7-aa9b-153091008e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:18:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-315111b8-613a-4d81-a0b1-e8f23bba47ad tempest-CreateVolumesFromImageTest-809537760 None] Created volume successfully. Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-c413dfef-9a6d-4b30-831e-c80663765208-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-c413dfef-9a6d-4b30-831e-c80663765208-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-quobyte-c413dfef-9a6d-4b30-831e-c80663765208" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-c413dfef-9a6d-4b30-831e-c80663765208" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ec62e-1994-4691-b4ef-462e9342ba2a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:55 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 Nov 04 19:18:55 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:55 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208" returned: 0 in 0.364s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:55 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208 Nov 04 19:18:55 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:55 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c413dfef-9a6d-4b30-831e-c80663765208" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-c413dfef-9a6d-4b30-831e-c80663765208" released by "delete_volume" :: held 0.651s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Created reservations ['c1371723-fdb4-45a5-aa07-1865b0c7ad0e', 'cfc64e62-c9a9-4fa2-a539-3bec8b71a351', 'a115ad37-3953-48d6-85a2-511f71ecde65', 'e4da256a-13ac-42ad-b017-deea67eb3490'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:55 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:55 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:55 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.235s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Deleted volume successfully. Nov 04 19:18:55 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-195edd34-2159-422a-8ebf-7dcdf9d2b041 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-c413dfef-9a6d-4b30-831e-c80663765208-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-7758ae7d-0214-43f5-b1ff-d0ee99da47f6-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-7758ae7d-0214-43f5-b1ff-d0ee99da47f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-quobyte-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed318f-7e74-4785-afe9-7bc4c0f8a1b2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:56 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 Nov 04 19:18:56 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:56 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" returned: 0 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:56 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6 Nov 04 19:18:56 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:56 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-7758ae7d-0214-43f5-b1ff-d0ee99da47f6" released by "delete_volume" :: held 0.637s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Created reservations ['babc09f5-f7d5-486c-8e03-1b248bfbc4da', '8674999a-8587-4702-861f-fa99acc233e4', 'c7f237b4-cd2a-4f29-bd42-0bf0b688cd08', '3b0fbe76-f571-4a17-9c9e-2653604a5a31'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:56 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:56 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:57 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Deleted volume successfully. Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dee7cab7-2623-40ec-8080-e2461d3c6c49 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-7758ae7d-0214-43f5-b1ff-d0ee99da47f6-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-d18cffb6-84ec-4227-b7b5-4e679f213b6f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-d18cffb6-84ec-4227-b7b5-4e679f213b6f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-quobyte-d18cffb6-84ec-4227-b7b5-4e679f213b6f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-d18cffb6-84ec-4227-b7b5-4e679f213b6f" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa0ec4-bdec-4171-adf1-4a2d8b773f98]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:57 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f Nov 04 19:18:57 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:57 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:57 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f Nov 04 19:18:57 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:57 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d18cffb6-84ec-4227-b7b5-4e679f213b6f" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-d18cffb6-84ec-4227-b7b5-4e679f213b6f" released by "delete_volume" :: held 0.657s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Created reservations ['02d33fdc-d072-47b3-9ca2-343daa651336', '19932124-e126-4008-b269-af251069eb9e', 'ac64dba5-50ac-4fbd-a7c0-3cde05d57d2c', 'f8dfe157-a16f-4ef8-9d93-2eddfb56483c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:58 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:58 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:58 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Deleted volume successfully. Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0958d0ae-675a-45d0-a47d-fd6bc6c70f41 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-d18cffb6-84ec-4227-b7b5-4e679f213b6f-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-50468682-c2eb-4524-8052-2f90d4e3e014-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-50468682-c2eb-4524-8052-2f90d4e3e014-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-quobyte-50468682-c2eb-4524-8052-2f90d4e3e014" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-50468682-c2eb-4524-8052-2f90d4e3e014" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4538e1-14c3-4b07-acc4-2e3c0a86bf76]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:58 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 Nov 04 19:18:58 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:58 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014" returned: 0 in 0.360s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:58 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014 Nov 04 19:18:58 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:59 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-50468682-c2eb-4524-8052-2f90d4e3e014" returned: 0 in 0.252s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-50468682-c2eb-4524-8052-2f90d4e3e014" released by "delete_volume" :: held 0.654s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Created reservations ['204c0a09-009a-435a-8f0e-2383afbc1a1f', '702cba08-1b2d-4d02-81b6-344847fbba68', '6601a597-da11-4ff1-85c1-bb81258835b3', '12619e14-16fd-416d-8556-ed67d9ad994a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:59 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:18:59 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:59 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:18:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Deleted volume successfully. Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a4bc8b5b-836f-4a56-aae6-8e0be29b8b25 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-50468682-c2eb-4524-8052-2f90d4e3e014-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-f33474f1-b57e-4697-b575-6c261f23c413-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-f33474f1-b57e-4697-b575-6c261f23c413-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "cinder-quobyte-f33474f1-b57e-4697-b575-6c261f23c413" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-f33474f1-b57e-4697-b575-6c261f23c413" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[174685cb-f66d-4580-8e8e-31d814e98e25]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:18:59 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 Nov 04 19:18:59 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:18:59 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413" returned: 0 in 0.350s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:18:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:00 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413 Nov 04 19:19:00 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:00 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f33474f1-b57e-4697-b575-6c261f23c413" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-quobyte-f33474f1-b57e-4697-b575-6c261f23c413" released by "delete_volume" :: held 0.634s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Created reservations ['e8ebc2ec-353a-4630-91dc-769c51fd7887', '871bd452-ae1b-498f-918d-162ec03200eb', 'a2170fa7-3cf5-43dc-8458-7956ee8b5507', 'ae7b0d35-cd12-4409-a524-a2ffc759d2f0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:00 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:00 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:00 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Deleted volume successfully. Nov 04 19:19:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b678f650-ed2b-479c-8eca-6f9bf53ba5a4 tempest-CreateVolumesFromImageTest-809537760 None] Lock "cinder-f33474f1-b57e-4697-b575-6c261f23c413-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (766e534f-f969-4e8b-8b7b-05d03a7697bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7f2f3-d2e5-4999-b55b-a033a5ae137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7f2f3-d2e5-4999-b55b-a033a5ae137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1450126902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8068eaa8-7353-4577-9afd-3deb48f6c27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:03Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff54db2-a1d9-4300-8d55-f37e65adc7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff54db2-a1d9-4300-8d55-f37e65adc7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1dfbe0-15db-4262-9940-400ffd290260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1dfbe0-15db-4262-9940-400ffd290260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8068eaa8-7353-4577-9afd-3deb48f6c27b', 'volume_name': 'volume-8068eaa8-7353-4577-9afd-3deb48f6c27b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c891e987-af09-4784-ad0d-b90f379bd66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c891e987-af09-4784-ad0d-b90f379bd66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee080cb-3b11-49c4-9bb5-bc2a1a9aaf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:03 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume 8068eaa8-7353-4577-9afd-3deb48f6c27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8068eaa8-7353-4577-9afd-3deb48f6c27b', 'volume_size': 1} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1450126902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8068eaa8-7353-4577-9afd-3deb48f6c27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:03Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume 8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:03 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:03 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b 1073741824 Nov 04 19:19:03 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:03 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b 1073741824" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=120,cinder:UPDATE=131,cinder:DELETE=11,cinder:INSERT=33 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:19:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:03 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b Nov 04 19:19:03 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:04 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee080cb-3b11-49c4-9bb5-bc2a1a9aaf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8068eaa8-7353-4577-9afd-3deb48f6c27b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42eb4051-6435-499d-8fc9-3b7e31862944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-8068eaa8-7353-4577-9afd-3deb48f6c27b (8068eaa8-7353-4577-9afd-3deb48f6c27b): created successfully Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42eb4051-6435-499d-8fc9-3b7e31862944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (766e534f-f969-4e8b-8b7b-05d03a7697bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cc1aa563-890f-43f6-8e3e-baf28eba87e1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating offline snapshot e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 of volume 8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba44fe-a1ef-494d-9ac2-3f5aa3823280]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:04 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b Nov 04 19:19:04 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:05 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b" returned: 0 in 0.344s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:05 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 1G Nov 04 19:19:05 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:05 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 1G" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8068eaa8-7353-4577-9afd-3deb48f6c27b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:05 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8068eaa8-7353-4577-9afd-3deb48f6c27b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 Nov 04 19:19:05 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:05 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8068eaa8-7353-4577-9afd-3deb48f6c27b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:05 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 is being set with open permissions: ugo+rw Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:05 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 Nov 04 19:19:05 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:05 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" returned: 0 in 0.234s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:06 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info Nov 04 19:19:06 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:06 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:06 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info is being set with open permissions: ugo+rw Nov 04 19:19:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:06 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info Nov 04 19:19:06 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:06 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.info" returned: 0 in 0.233s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-519d750f-b44e-45d8-a89c-bb3f4d1bec5e tempest-CreateVolumesFromSnapshotTest-974319522 None] Create snapshot completed successfully Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (cc60017c-f8df-493f-bade-9bb0d68cab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc02683-b870-4b22-861b-398b6cad4e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc02683-b870-4b22-861b-398b6cad4e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454891831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca237d9c-b0c7-469d-9fba-1697b9d0d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:07Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c8ebee-c0b2-4123-9a10-6feea06dadfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c8ebee-c0b2-4123-9a10-6feea06dadfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028454c7-8a75-47e2-bd72-c9015f822d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028454c7-8a75-47e2-bd72-c9015f822d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca237d9c-b0c7-469d-9fba-1697b9d0d4f0', 'volume_name': 'volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d833b2-5a52-450a-998b-21e9b1906efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d833b2-5a52-450a-998b-21e9b1906efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fad09b-81d4-45ce-aaac-5195bc323cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume ca237d9c-b0c7-469d-9fba-1697b9d0d4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0', 'volume_size': 1} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454891831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca237d9c-b0c7-469d-9fba-1697b9d0d4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:07Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:07 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 1073741824 Nov 04 19:19:07 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (8d3ab7d7-b824-4c3b-a569-3b49c4cd8d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99251e33-e86d-409f-837b-124287adbd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99251e33-e86d-409f-837b-124287adbd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1527333703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3483c82-d485-403c-a2c2-cf23710e80bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:07Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfba736-bbc1-4dab-aa34-da3655133a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfba736-bbc1-4dab-aa34-da3655133a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6210300-ab54-4598-ae6d-43b4f3e63949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6210300-ab54-4598-ae6d-43b4f3e63949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3483c82-d485-403c-a2c2-cf23710e80bf', 'volume_name': 'volume-e3483c82-d485-403c-a2c2-cf23710e80bf', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c304750-86e6-4393-8c46-d703f3d819e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c304750-86e6-4393-8c46-d703f3d819e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17ae874-bcaa-4ee1-b9ad-ef266b0e65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume e3483c82-d485-403c-a2c2-cf23710e80bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3483c82-d485-403c-a2c2-cf23710e80bf', 'volume_size': 1} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:07 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 1073741824" returned: 0 in 0.540s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:07 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 Nov 04 19:19:07 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (3decd44f-dab1-4800-bbbf-a847e3d6c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867ff31-273c-43b5-9052-ca4b39cca4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8867ff31-273c-43b5-9052-ca4b39cca4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454537220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767e44de-503f-4e19-a4e3-8a9f9f7d5a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:08Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2473c9e-3016-42d4-aedd-4a432102a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2473c9e-3016-42d4-aedd-4a432102a755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb6b4fc-aa98-46f4-ada5-22d1f535db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb6b4fc-aa98-46f4-ada5-22d1f535db9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767e44de-503f-4e19-a4e3-8a9f9f7d5a93', 'volume_name': 'volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f68c6bc-89fa-4390-9aca-8107af248573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f68c6bc-89fa-4390-9aca-8107af248573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdeba0a-3aab-4008-a305-fd0dc629a8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume 767e44de-503f-4e19-a4e3-8a9f9f7d5a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93', 'volume_size': 1} Nov 04 19:19:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:08 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" returned: 0 in 0.267s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1527333703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3483c82-d485-403c-a2c2-cf23710e80bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:07Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume e3483c82-d485-403c-a2c2-cf23710e80bf {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fad09b-81d4-45ce-aaac-5195bc323cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf 1073741824 Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9422033e-ab1c-41f7-94a0-4b9697aea4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 (ca237d9c-b0c7-469d-9fba-1697b9d0d4f0): created successfully Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9422033e-ab1c-41f7-94a0-4b9697aea4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (cc60017c-f8df-493f-bade-9bb0d68cab0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7e267633-cf30-45f5-bf9e-59e2e335be1e tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (8f27821f-d038-4718-a377-0ac53357fa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b9e2c9-f9c9-458c-b43b-3b33a6043985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b9e2c9-f9c9-458c-b43b-3b33a6043985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108591860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e6b6c2-3908-4fbb-9090-73fe57051d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:08Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96637f3b-bfb6-4a74-89e5-50813560e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96637f3b-bfb6-4a74-89e5-50813560e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884ba627-a7cd-4332-a10a-ed2cf329ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884ba627-a7cd-4332-a10a-ed2cf329ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e6b6c2-3908-4fbb-9090-73fe57051d6b', 'volume_name': 'volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da3d6ea-1780-467d-aaf6-96a349d385ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da3d6ea-1780-467d-aaf6-96a349d385ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae821b0b-f8d1-48f2-903c-97aad846763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume 38e6b6c2-3908-4fbb-9090-73fe57051d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b', 'volume_size': 1} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:08 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf 1073741824" returned: 0 in 0.507s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:08 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf Nov 04 19:19:08 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (26383647-7599-4218-8859-31806d3b85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b5027a-d7a9-4e67-9123-83292b7c50c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b5027a-d7a9-4e67-9123-83292b7c50c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-456920062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0062a6-e805-4051-b5d0-4b0104df2a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:09Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571dabcf-8649-47d9-89e3-31705c4b4215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571dabcf-8649-47d9-89e3-31705c4b4215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c9ead-8863-4645-8252-e91015cdce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7c9ead-8863-4645-8252-e91015cdce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0062a6-e805-4051-b5d0-4b0104df2a66', 'volume_name': 'volume-fb0062a6-e805-4051-b5d0-4b0104df2a66', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20484ce-2f10-4248-b505-9bd77ea639e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20484ce-2f10-4248-b505-9bd77ea639e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f26cb8-beea-43a9-b821-ae874d215eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume fb0062a6-e805-4051-b5d0-4b0104df2a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0062a6-e805-4051-b5d0-4b0104df2a66', 'volume_size': 1} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:08 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454537220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767e44de-503f-4e19-a4e3-8a9f9f7d5a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:08Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume 767e44de-503f-4e19-a4e3-8a9f9f7d5a93 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17ae874-bcaa-4ee1-b9ad-ef266b0e65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3483c82-d485-403c-a2c2-cf23710e80bf', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 1073741824 Nov 04 19:19:08 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9c0a37-4f81-48b8-99f2-897084062cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-e3483c82-d485-403c-a2c2-cf23710e80bf (e3483c82-d485-403c-a2c2-cf23710e80bf): created successfully Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9c0a37-4f81-48b8-99f2-897084062cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (8d3ab7d7-b824-4c3b-a569-3b49c4cd8d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-674dc6cf-d41d-4f04-853b-d4034d86efea tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:09 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 1073741824" returned: 0 in 0.415s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:09 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 Nov 04 19:19:09 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:09 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" returned: 0 in 0.233s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108591860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e6b6c2-3908-4fbb-9090-73fe57051d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:08Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume 38e6b6c2-3908-4fbb-9090-73fe57051d6b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:09 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:09 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b 1073741824 Nov 04 19:19:09 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdeba0a-3aab-4008-a305-fd0dc629a8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976db3b6-c8c7-4f27-8b25-733169c69715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 (767e44de-503f-4e19-a4e3-8a9f9f7d5a93): created successfully Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976db3b6-c8c7-4f27-8b25-733169c69715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (3decd44f-dab1-4800-bbbf-a847e3d6c87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b2e95f0b-57c9-4c61-89e5-13186deff131 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:09 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b 1073741824" returned: 0 in 0.422s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:10 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b Nov 04 19:19:10 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:10 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-456920062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0062a6-e805-4051-b5d0-4b0104df2a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10896f2417634d42a7c3864c59c90b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:09Z,use_quota=True,user_id='54a600733a084ba59a24d21d696da7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Creating volume fb0062a6-e805-4051-b5d0-4b0104df2a66 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:10 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae821b0b-f8d1-48f2-903c-97aad846763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664e45f4-9a83-4a05-be00-30516b14316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:10 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 1073741824 Nov 04 19:19:10 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b (38e6b6c2-3908-4fbb-9090-73fe57051d6b): created successfully Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664e45f4-9a83-4a05-be00-30516b14316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (8f27821f-d038-4718-a377-0ac53357fa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0b172b88-5ad5-4baa-98bf-207a0dcf245e tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:10 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 1073741824" returned: 0 in 0.425s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:10 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 Nov 04 19:19:10 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:10 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66" returned: 0 in 0.237s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f26cb8-beea-43a9-b821-ae874d215eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0062a6-e805-4051-b5d0-4b0104df2a66', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca1514-8269-403a-bbb0-6e6c951a99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Volume volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 (fb0062a6-e805-4051-b5d0-4b0104df2a66): created successfully Nov 04 19:19:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca1514-8269-403a-bbb0-6e6c951a99ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Flow 'volume_create_manager' (26383647-7599-4218-8859-31806d3b85f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8681bfc8-23f9-4f2b-9ab3-4d2dfc763866 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created volume successfully. Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-fb0062a6-e805-4051-b5d0-4b0104df2a66-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-fb0062a6-e805-4051-b5d0-4b0104df2a66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-fb0062a6-e805-4051-b5d0-4b0104df2a66" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-fb0062a6-e805-4051-b5d0-4b0104df2a66" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[913486da-a320-4072-91d0-b7c6e348c851]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:12 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 Nov 04 19:19:12 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:12 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:12 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66 Nov 04 19:19:12 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:12 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-fb0062a6-e805-4051-b5d0-4b0104df2a66" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-fb0062a6-e805-4051-b5d0-4b0104df2a66" released by "delete_volume" :: held 0.669s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['fbc616e4-fded-4334-9ae0-8f5de22bdbdb', 'ee5e29b5-96a1-41bb-9ced-394a50f58475', '44e90136-9f56-49f7-95a1-b552f00939bc', 'e11e3db1-cdf1-4ba7-a9e3-3ced65a5048b'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:12 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:12 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:13 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1f849ecc-4dd7-4596-8006-b58bd0be66c2 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-fb0062a6-e805-4051-b5d0-4b0104df2a66-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-38e6b6c2-3908-4fbb-9090-73fe57051d6b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-38e6b6c2-3908-4fbb-9090-73fe57051d6b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-38e6b6c2-3908-4fbb-9090-73fe57051d6b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-38e6b6c2-3908-4fbb-9090-73fe57051d6b" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c72eb-5d27-4cfa-b86d-dd9a2aeef080]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:13 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b Nov 04 19:19:13 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:13 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b" returned: 0 in 0.362s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:13 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b Nov 04 19:19:13 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:13 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-38e6b6c2-3908-4fbb-9090-73fe57051d6b" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-38e6b6c2-3908-4fbb-9090-73fe57051d6b" released by "delete_volume" :: held 0.642s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['303ed8c8-268d-428d-8776-dfa2d0e1a9bc', 'f2cf8ef5-9ed7-4881-baf7-bc38af83195a', '0b4567a7-c364-4456-8bde-096ce6d30130', '99488acc-ba3e-41d1-bf0b-1948122e5a19'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:14 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:14 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:14 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-82c00461-fc56-469a-9c12-15693efae2e7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-38e6b6c2-3908-4fbb-9090-73fe57051d6b-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-767e44de-503f-4e19-a4e3-8a9f9f7d5a93-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-767e44de-503f-4e19-a4e3-8a9f9f7d5a93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8295b992-7ede-4a9e-8eab-fd1f56f84e90]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:14 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 Nov 04 19:19:14 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:14 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" returned: 0 in 0.357s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:14 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93 Nov 04 19:19:14 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:15 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-767e44de-503f-4e19-a4e3-8a9f9f7d5a93" released by "delete_volume" :: held 0.635s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['45739787-be3d-41b0-b170-6c05e80d87b7', '64f5e6ed-bd40-4e88-8c6a-2513c22e6c7a', '4b1f2d28-8a98-44e5-a166-461b09fe49bd', '339e6644-f873-48e7-9159-e16fe3040ce6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:15 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:15 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:15 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a66fac22-ed4c-460f-939a-4474cdf920ad tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-767e44de-503f-4e19-a4e3-8a9f9f7d5a93-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-e3483c82-d485-403c-a2c2-cf23710e80bf-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-e3483c82-d485-403c-a2c2-cf23710e80bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-e3483c82-d485-403c-a2c2-cf23710e80bf" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-e3483c82-d485-403c-a2c2-cf23710e80bf" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ccdb57-ea6a-4ca3-8aee-551e24228152]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:15 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf Nov 04 19:19:15 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:15 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:15 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf Nov 04 19:19:15 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:16 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e3483c82-d485-403c-a2c2-cf23710e80bf" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-e3483c82-d485-403c-a2c2-cf23710e80bf" released by "delete_volume" :: held 0.637s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['710c60ef-8005-4c0c-a07a-5320a78ad54a', 'f937ae74-8736-407f-8922-9e9bd80e84e8', 'f7637235-a129-4524-ba2c-f1c6944c26fd', '43fe2edc-acd1-476c-a645-621574702899'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:16 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:16 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:16 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.257s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6cda387d-5eff-4ca0-8481-cc75e9ed7bc7 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-e3483c82-d485-403c-a2c2-cf23710e80bf-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[885630a0-d1b5-463d-9525-5acf3a15649c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:16 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 Nov 04 19:19:16 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:17 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" returned: 0 in 0.348s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:17 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0 Nov 04 19:19:17 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:17 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" returned: 0 in 0.251s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0" released by "delete_volume" :: held 0.638s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['3ac9cf11-e0fc-4661-a321-466018f3bb98', '16fa93a2-3deb-477f-956b-3cef5fed70ec', '4fc52ce5-3acc-4887-9443-6c9f0911027e', 'b436cbb0-1c9b-4c61-9ed1-9bfba23f41ad'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:17 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:17 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:17 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.257s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-43f4b5c9-5e50-4b44-820c-1e0a62c81d6a tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-ca237d9c-b0c7-469d-9fba-1697b9d0d4f0-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleting offline snapshot e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 of volume 8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] snapshot_file for this snap is: volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1401f-5981-4ab5-a663-9e932b95fd66]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:18 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 Nov 04 19:19:18 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:18 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" returned: 0 in 0.365s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8068eaa8-7353-4577-9afd-3deb48f6c27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[adabe5b2-6c99-4080-846d-5926a517be5b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:18 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b Nov 04 19:19:18 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:18 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b" returned: 0 in 0.363s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:18 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 Nov 04 19:19:18 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:19 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:19 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5 Nov 04 19:19:19 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:19 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b.e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5" released by "_delete_snapshot" :: held 1.403s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" released by "delete_snapshot" :: held 1.424s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['05d2c1e5-7e99-45f6-a267-b00c1443455b', '38604bf2-d225-47ce-9185-d8992f4b0fe9', '5308ec49-d42f-4d4b-846c-c96773480f53', '32059fe2-372d-41ec-acf9-fac278b964ef'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Delete snapshot completed successfully. Nov 04 19:19:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a9b6dec-f4e8-4a71-857d-8d0ec645eae1 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-e1f22daf-18f8-4559-8e50-a5a70b6c6ff5-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-8068eaa8-7353-4577-9afd-3deb48f6c27b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-8068eaa8-7353-4577-9afd-3deb48f6c27b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12f0ed-36e1-4210-8436-4cffa3a42335]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:20 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b Nov 04 19:19:20 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:20 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:20 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b Nov 04 19:19:20 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:20 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8068eaa8-7353-4577-9afd-3deb48f6c27b" returned: 0 in 0.265s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-quobyte-8068eaa8-7353-4577-9afd-3deb48f6c27b" released by "delete_volume" :: held 0.705s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=175,cinder:SELECT=113,cinder:INSERT=42,cinder:DELETE=18 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Created reservations ['d438b051-f0bc-469f-840b-cbf8fa7f1880', '8c4eb481-6c53-4ac4-9d26-7faee4b26615', '97894a4e-c4f8-45af-a4c0-9084a1746b5e', '90c2b856-eef6-4ecb-b5c9-8dcd6a5c0979'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:20 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:20 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:21 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.241s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Deleted volume successfully. Nov 04 19:19:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-73ccf64a-523c-43de-9459-0bb5f592a1a5 tempest-CreateVolumesFromSnapshotTest-974319522 None] Lock "cinder-8068eaa8-7353-4577-9afd-3deb48f6c27b-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:22 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:22 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:22 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.263s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:19:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Flow 'volume_create_manager' (2c97d2b5-8f1e-4462-8018-8e9a98c2b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db806871-3e41-4c4b-9f36-eeb418258a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db806871-3e41-4c4b-9f36-eeb418258a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-800884449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e183bf8b-5d0a-4831-b423-ae64ceba6c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc95b30a9ca462ebc03df0f4c879b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:24Z,use_quota=True,user_id='13e5a5c9776545aaba8b9b92a4c04718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166eb4eb-43e9-4c71-b6e6-a93c3314daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166eb4eb-43e9-4c71-b6e6-a93c3314daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581e7e5f-4a1c-4128-8a75-9aaeb1ebcfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581e7e5f-4a1c-4128-8a75-9aaeb1ebcfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e183bf8b-5d0a-4831-b423-ae64ceba6c6b', 'volume_name': 'volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50c43fe-9d63-4453-9a15-db79e3245930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50c43fe-9d63-4453-9a15-db79e3245930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e9148-4895-49fd-8f46-ae6ae2f454f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:23 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Volume e183bf8b-5d0a-4831-b423-ae64ceba6c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b', 'volume_size': 1} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-800884449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e183bf8b-5d0a-4831-b423-ae64ceba6c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc95b30a9ca462ebc03df0f4c879b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:24Z,use_quota=True,user_id='13e5a5c9776545aaba8b9b92a4c04718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Creating volume e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:23 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:23 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b 1073741824 Nov 04 19:19:23 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:24 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b 1073741824" returned: 0 in 0.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:24 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:24 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:24 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.251s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e9148-4895-49fd-8f46-ae6ae2f454f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe938f2-665b-4f88-98c3-f5395281e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Volume volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b (e183bf8b-5d0a-4831-b423-ae64ceba6c6b): created successfully Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe938f2-665b-4f88-98c3-f5395281e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Flow 'volume_create_manager' (2c97d2b5-8f1e-4462-8018-8e9a98c2b823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5ca4b404-8805-417a-b307-60f11200b211 tempest-VolumeDependencyTests-955432442 None] Created volume successfully. Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Creating offline snapshot 80991fc9-a0a5-4780-a52e-f239a9313a1a of volume e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806791f-22eb-47d5-9b30-1cc049419276]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:25 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:25 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:25 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.355s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:25 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a 1G Nov 04 19:19:25 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:25 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a 1G" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:25 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:25 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:26 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.282s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:26 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a is being set with open permissions: ugo+rw Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:26 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:26 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:26 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.235s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:26 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info Nov 04 19:19:26 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:26 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:26 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info is being set with open permissions: ugo+rw Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:26 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info Nov 04 19:19:26 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:26 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.info" returned: 0 in 0.233s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5b898f6d-6677-4ddc-a772-97f33b895a49 tempest-VolumeDependencyTests-955432442 None] Create snapshot completed successfully Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Flow 'volume_create_manager' (09d016e4-17c1-41ef-a010-f116a775be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5cc0a2-f301-47da-a720-cef225a2a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a5cc0a2-f301-47da-a720-cef225a2a25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1947548281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0843e9f-094c-49f4-84bf-2679ea45f1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc95b30a9ca462ebc03df0f4c879b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80991fc9-a0a5-4780-a52e-f239a9313a1a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:28Z,use_quota=True,user_id='13e5a5c9776545aaba8b9b92a4c04718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0696ac-f4da-45af-8e53-a6335f3f23fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0696ac-f4da-45af-8e53-a6335f3f23fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5b94d-ae89-429f-97a5-9f5365c42186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5b94d-ae89-429f-97a5-9f5365c42186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0843e9f-094c-49f4-84bf-2679ea45f1a4', 'volume_name': 'volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4', 'volume_size': 1, 'snapshot_id': '80991fc9-a0a5-4780-a52e-f239a9313a1a'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78fc46b-6db7-4ccd-886e-1845d619c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78fc46b-6db7-4ccd-886e-1845d619c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed7e055-8670-4f35-bd6d-2ccb8ac3019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:27 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Volume e0843e9f-094c-49f4-84bf-2679ea45f1a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4', 'volume_size': 1, 'snapshot_id': '80991fc9-a0a5-4780-a52e-f239a9313a1a'} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a-e0843e9f-094c-49f4-84bf-2679ea45f1a4" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a-e0843e9f-094c-49f4-84bf-2679ea45f1a4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Creating volume e0843e9f-094c-49f4-84bf-2679ea45f1a4 from snapshot 80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] snapshot: 80991fc9-a0a5-4780-a52e-f239a9313a1a, volume: e0843e9f-094c-49f4-84bf-2679ea45f1a4, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da75cd6-e3d3-4a78-8010-8b1436fc85f3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:27 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:27 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:28 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.352s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f962e89-9c9d-42e2-a319-4f773236ef2f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:28 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:28 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:28 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:19:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:28 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 Nov 04 19:19:28 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:34 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4" returned: 0 in 5.839s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:19:34 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Converted 1024.00 MB image at 175.34 MB/s Nov 04 19:19:34 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 is being set with open permissions: ugo+rw Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:34 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 Nov 04 19:19:34 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:34 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" released by "_copy_volume_from_snapshot" :: held 6.898s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a-e0843e9f-094c-49f4-84bf-2679ea45f1a4" released by "_create_volume_from_snapshot" :: held 6.962s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.980s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed7e055-8670-4f35-bd6d-2ccb8ac3019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4', 'volume_size': 1, 'snapshot_id': '80991fc9-a0a5-4780-a52e-f239a9313a1a'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d60bb-8207-48db-b324-ee49c241411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:34 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Volume volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 (e0843e9f-094c-49f4-84bf-2679ea45f1a4): created successfully Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d60bb-8207-48db-b324-ee49c241411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Flow 'volume_create_manager' (09d016e4-17c1-41ef-a010-f116a775be9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:34 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fb578907-ad09-4a25-8e7d-20b537392677 tempest-VolumeDependencyTests-955432442 None] Created volume successfully. Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-80991fc9-a0a5-4780-a52e-f239a9313a1a-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-80991fc9-a0a5-4780-a52e-f239a9313a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Deleting offline snapshot 80991fc9-a0a5-4780-a52e-f239a9313a1a of volume e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] snapshot_file for this snap is: volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[48787edc-6ae6-4099-ad00-a1fc2b4acbbd]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:35 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:35 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:35 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.346s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb8e8a-656f-47c4-8a83-379aefe17e1f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:35 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:35 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:36 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.531s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:36 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:36 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:36 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.337s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:36 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a Nov 04 19:19:36 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:36 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b.80991fc9-a0a5-4780-a52e-f239a9313a1a" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-80991fc9-a0a5-4780-a52e-f239a9313a1a" released by "_delete_snapshot" :: held 1.569s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" released by "delete_snapshot" :: held 1.593s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Created reservations ['e5faf3f7-bc2a-4ab8-b702-fe59ada01814', '73015dd4-4454-4edb-9764-3a0a4bc917df', 'ddd86448-97a3-442e-9815-3ab15bfea5dd', 'b25881ee-dd3c-4989-996f-3814c51e4945'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:36 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Delete snapshot completed successfully. Nov 04 19:19:36 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-f82ee8a2-ea84-4517-a4f0-36b4d3087243 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-80991fc9-a0a5-4780-a52e-f239a9313a1a-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-e183bf8b-5d0a-4831-b423-ae64ceba6c6b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "cinder-e183bf8b-5d0a-4831-b423-ae64ceba6c6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" acquired by "delete_volume" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f078fe-1b65-4765-88b7-f6347266b1d6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:37 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:37 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:37 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:37 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b Nov 04 19:19:37 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:38 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e183bf8b-5d0a-4831-b423-ae64ceba6c6b" released by "delete_volume" :: held 0.651s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Created reservations ['5f7a9f40-2124-45f9-8f23-b805ce9765a7', '3a272c0d-16a1-4d60-a062-901caac14873', '0e364f8a-f516-4bd5-a32e-fb61ddd4a3ee', '471a3435-4027-497e-aebd-8ac50d55c8ae'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:38 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:38 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:38 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Deleted volume successfully. Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0e8a0413-41ab-461d-bf26-19c91302dd9f tempest-VolumeDependencyTests-955432442 None] Lock "cinder-e183bf8b-5d0a-4831-b423-ae64ceba6c6b-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-e0843e9f-094c-49f4-84bf-2679ea45f1a4-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-e0843e9f-094c-49f4-84bf-2679ea45f1a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbac0f63-089a-4075-bb19-011842117e1b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:38 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 Nov 04 19:19:38 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:38 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:39 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4 Nov 04 19:19:39 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:39 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e0843e9f-094c-49f4-84bf-2679ea45f1a4" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-quobyte-e0843e9f-094c-49f4-84bf-2679ea45f1a4" released by "delete_volume" :: held 0.652s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Created reservations ['d02ca227-5b83-4d93-8935-f268d9924bb2', '75d044fc-eaab-4d82-b72a-832bad1e541b', '4137a6ee-8e3e-430c-ad8d-e5917654772a', 'a11bf3aa-e30a-4add-bdb8-34afe6d22c52'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:39 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:39 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:39 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Deleted volume successfully. Nov 04 19:19:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-93fd2f80-3177-4640-8270-fcd8fa99f661 tempest-VolumeDependencyTests-955432442 None] Lock "cinder-e0843e9f-094c-49f4-84bf-2679ea45f1a4-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:42 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:42 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Flow 'volume_create_manager' (7791b419-2379-4b19-814c-86a6aadc2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:42 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c349e811-db41-4b70-904a-a822e99f9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c349e811-db41-4b70-904a-a822e99f9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000110354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ca3436-da53-4089-a542-1a9689c34214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77bdcf1eb7b3406c9a6ada765a4150b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:43Z,use_quota=True,user_id='4c2be183421644fc8e578a26ce4cdb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feffc34c-9726-4ebf-a2cb-35965770d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feffc34c-9726-4ebf-a2cb-35965770d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692128cf-c0b4-4f22-9064-87e7dd9f8e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692128cf-c0b4-4f22-9064-87e7dd9f8e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ca3436-da53-4089-a542-1a9689c34214', 'volume_name': 'volume-59ca3436-da53-4089-a542-1a9689c34214', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99db977c-ca89-4f23-95a8-a8b9fd75885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99db977c-ca89-4f23-95a8-a8b9fd75885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca505d8f-66e6-4745-b448-a27a91ee3384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Volume 59ca3436-da53-4089-a542-1a9689c34214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ca3436-da53-4089-a542-1a9689c34214', 'volume_size': 1} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000110354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ca3436-da53-4089-a542-1a9689c34214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77bdcf1eb7b3406c9a6ada765a4150b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:43Z,use_quota=True,user_id='4c2be183421644fc8e578a26ce4cdb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Creating volume 59ca3436-da53-4089-a542-1a9689c34214 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:43 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:43 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 1073741824 Nov 04 19:19:43 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:43 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 1073741824" returned: 0 in 0.436s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:43 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 Nov 04 19:19:43 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:43 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca505d8f-66e6-4745-b448-a27a91ee3384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ca3436-da53-4089-a542-1a9689c34214', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327c4a8d-77ae-4eae-8d61-6eb730867777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:43 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Volume volume-59ca3436-da53-4089-a542-1a9689c34214 (59ca3436-da53-4089-a542-1a9689c34214): created successfully Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327c4a8d-77ae-4eae-8d61-6eb730867777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Flow 'volume_create_manager' (7791b419-2379-4b19-814c-86a6aadc2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2c345c87-b122-48cc-ad20-f566ac136407 tempest-ProjectReaderTests-1135793848 None] Created volume successfully. Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Acquiring lock "cinder-59ca3436-da53-4089-a542-1a9689c34214-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "cinder-59ca3436-da53-4089-a542-1a9689c34214-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Acquiring lock "cinder-quobyte-59ca3436-da53-4089-a542-1a9689c34214" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "cinder-quobyte-59ca3436-da53-4089-a542-1a9689c34214" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243418b-8f85-4972-bfe2-a22116eeabc0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:44 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 Nov 04 19:19:44 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:44 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214" returned: 0 in 0.362s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:44 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214 Nov 04 19:19:44 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:44 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-59ca3436-da53-4089-a542-1a9689c34214" returned: 0 in 0.241s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "cinder-quobyte-59ca3436-da53-4089-a542-1a9689c34214" released by "delete_volume" :: held 0.646s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Created reservations ['57f29acd-ac1a-4ea1-a008-a0d90b186506', '9917df52-f2c1-49f7-adf0-cb174a1a25b2', '9db042cb-4816-4f48-bd56-548ad497d54b', '4b8beda7-2370-49b4-a18b-ac47dff9c538'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:44 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:44 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:45 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.240s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:45 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Deleted volume successfully. Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8de98d44-a8ba-4042-9d27-80bd3d9521ee tempest-ProjectReaderTests-1135793848 None] Lock "cinder-59ca3436-da53-4089-a542-1a9689c34214-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Flow 'volume_create_manager' (5e7aa9ff-3bca-45d8-beee-e53b639d105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bffd0e-df4e-4d53-8fae-b60349292bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bffd0e-df4e-4d53-8fae-b60349292bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753030604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77bdcf1eb7b3406c9a6ada765a4150b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:46Z,use_quota=True,user_id='4c2be183421644fc8e578a26ce4cdb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c5bc3e-8afc-4c33-ab6e-7ba7c2bb2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c5bc3e-8afc-4c33-ab6e-7ba7c2bb2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789a5689-814b-409f-9498-c38aa1ebe335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789a5689-814b-409f-9498-c38aa1ebe335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de', 'volume_name': 'volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dce243-7988-42db-a221-14238d8a7904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dce243-7988-42db-a221-14238d8a7904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469bea5e-af29-4af5-9ecf-0448eceba4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:45 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Volume f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de', 'volume_size': 1} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753030604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77bdcf1eb7b3406c9a6ada765a4150b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:46Z,use_quota=True,user_id='4c2be183421644fc8e578a26ce4cdb3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Creating volume f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:45 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:45 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de 1073741824 Nov 04 19:19:45 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:46 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de 1073741824" returned: 0 in 0.392s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:46 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de Nov 04 19:19:46 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:46 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" returned: 0 in 0.251s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469bea5e-af29-4af5-9ecf-0448eceba4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4440b72d-4f57-458a-828f-1465b423e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:46 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Volume volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de (f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de): created successfully Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4440b72d-4f57-458a-828f-1465b423e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Flow 'volume_create_manager' (5e7aa9ff-3bca-45d8-beee-e53b639d105d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cd83f5c2-2387-4753-bbd2-0f1582c78c15 tempest-ProjectReaderTests-1135793848 None] Created volume successfully. Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "cinder-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "cinder-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "cinder-quobyte-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "cinder-quobyte-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a30e32-7ddb-4fac-ab85-3f29df808997]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:46 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de Nov 04 19:19:46 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:47 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:47 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de Nov 04 19:19:47 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:47 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "cinder-quobyte-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de" released by "delete_volume" :: held 0.618s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Created reservations ['71deab6d-2593-42f4-a810-d3d734964c7f', 'd384eac7-c2d0-4a93-afcf-e29d49c2be8e', 'e5060c78-7c28-4608-bf58-c5b8fde6f4e9', '986e8dd3-f49b-47db-87b7-7c327722599e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:47 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:47 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:47 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Deleted volume successfully. Nov 04 19:19:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-fd9ce6c8-6a3e-4a7a-9f45-c232789534b3 tempest-ProjectReaderTests-1135793848 None] Lock "cinder-f9c9b9b8-8d0d-45b3-9410-fdeaa3dd83de-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (0c99b716-54da-4bdf-8885-ca56f1deb767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9320dcba-4915-4efb-995a-d4c0009c3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9320dcba-4915-4efb-995a-d4c0009c3504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963428064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbd1d15-0792-4973-a21e-fb5b00c56046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:56Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70718c25-fa83-46be-a62b-01863e2940f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70718c25-fa83-46be-a62b-01863e2940f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ed2354-aaf0-46f2-8ea5-f05a5fa5b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ed2354-aaf0-46f2-8ea5-f05a5fa5b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbd1d15-0792-4973-a21e-fb5b00c56046', 'volume_name': 'volume-acbd1d15-0792-4973-a21e-fb5b00c56046', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367bd8e1-1d02-4227-a769-4ab39fdc9795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367bd8e1-1d02-4227-a769-4ab39fdc9795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be6f7c4-143f-465e-b2f3-c5a14863ecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Volume acbd1d15-0792-4973-a21e-fb5b00c56046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbd1d15-0792-4973-a21e-fb5b00c56046', 'volume_size': 1} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963428064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbd1d15-0792-4973-a21e-fb5b00c56046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:56Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Creating volume acbd1d15-0792-4973-a21e-fb5b00c56046 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:56 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:56 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 1073741824 Nov 04 19:19:56 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:56 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 1073741824" returned: 0 in 0.408s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:56 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 Nov 04 19:19:56 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:56 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046" returned: 0 in 0.244s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be6f7c4-143f-465e-b2f3-c5a14863ecd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbd1d15-0792-4973-a21e-fb5b00c56046', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9980ac-d2ee-48b5-8639-40700e058c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:56 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Volume volume-acbd1d15-0792-4973-a21e-fb5b00c56046 (acbd1d15-0792-4973-a21e-fb5b00c56046): created successfully Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9980ac-d2ee-48b5-8639-40700e058c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:56 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (0c99b716-54da-4bdf-8885-ca56f1deb767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fbe8d43e-67b7-4907-9a21-6be2d22fc371 tempest-ProjectReaderTests-2081559958 None] Created volume successfully. Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-acbd1d15-0792-4973-a21e-fb5b00c56046-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "cinder-acbd1d15-0792-4973-a21e-fb5b00c56046-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-quobyte-acbd1d15-0792-4973-a21e-fb5b00c56046" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-acbd1d15-0792-4973-a21e-fb5b00c56046" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5a375-4473-499d-bd87-2995684a98c8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:57 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 Nov 04 19:19:57 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:57 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046" returned: 0 in 0.349s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:57 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046 Nov 04 19:19:57 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:57 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-acbd1d15-0792-4973-a21e-fb5b00c56046" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-acbd1d15-0792-4973-a21e-fb5b00c56046" released by "delete_volume" :: held 0.636s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Created reservations ['9676d543-5082-4699-95e1-14c5f974af94', 'b26037a4-4b84-44c9-9d58-4be43902ae0b', 'd2c756b2-94c6-423f-9f24-360bd32b786a', 'b2fd3991-4f11-4a2e-9e0c-a49fd9cef6d0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:58 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:19:58 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:58 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:19:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Deleted volume successfully. Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cabdd373-3780-47ee-9a11-9eb7e1759e6f tempest-ProjectReaderTests-2081559958 None] Lock "cinder-acbd1d15-0792-4973-a21e-fb5b00c56046-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (dfe613ed-7de2-4d15-9af6-b6aac0fe9c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02681f7-0234-4752-9a33-88f4a76fae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02681f7-0234-4752-9a33-88f4a76fae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90256720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635bef38-5457-45a3-a518-b09abe04de92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:59Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2392579a-5d90-41df-8150-9d767159cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2392579a-5d90-41df-8150-9d767159cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a0c474-e61e-4715-92de-ac7b353de633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a0c474-e61e-4715-92de-ac7b353de633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635bef38-5457-45a3-a518-b09abe04de92', 'volume_name': 'volume-635bef38-5457-45a3-a518-b09abe04de92', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335970b2-5908-4f68-adbe-ee51938f3b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335970b2-5908-4f68-adbe-ee51938f3b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b340b1-87ff-4d67-b111-a8037354dd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:58 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Volume 635bef38-5457-45a3-a518-b09abe04de92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635bef38-5457-45a3-a518-b09abe04de92', 'volume_size': 1} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-90256720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635bef38-5457-45a3-a518-b09abe04de92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:19:59Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Creating volume 635bef38-5457-45a3-a518-b09abe04de92 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:19:58 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:19:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:58 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 1073741824 Nov 04 19:19:58 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:59 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 1073741824" returned: 0 in 0.417s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:19:59 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 Nov 04 19:19:59 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:19:59 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b340b1-87ff-4d67-b111-a8037354dd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635bef38-5457-45a3-a518-b09abe04de92', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de61ce81-6285-4034-84fc-b419a74dd576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:19:59 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Volume volume-635bef38-5457-45a3-a518-b09abe04de92 (635bef38-5457-45a3-a518-b09abe04de92): created successfully Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de61ce81-6285-4034-84fc-b419a74dd576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (dfe613ed-7de2-4d15-9af6-b6aac0fe9c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:19:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ffcbc110-9a04-440b-b382-d3e1776630b0 tempest-ProjectReaderTests-2081559958 None] Created volume successfully. Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-635bef38-5457-45a3-a518-b09abe04de92-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-635bef38-5457-45a3-a518-b09abe04de92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-quobyte-635bef38-5457-45a3-a518-b09abe04de92" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-635bef38-5457-45a3-a518-b09abe04de92" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e60f91-e18d-42b9-9071-b8f7450a5b52]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:19:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:00 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 Nov 04 19:20:00 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:00 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:00 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92 Nov 04 19:20:00 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:00 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-635bef38-5457-45a3-a518-b09abe04de92" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-635bef38-5457-45a3-a518-b09abe04de92" released by "delete_volume" :: held 0.668s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Created reservations ['f179deb9-11de-4cc7-b0fd-a518ef8bf3d5', '5e4c761c-ac50-4236-a753-eed78d0ca298', '07fdfa8a-b895-4feb-9204-7a8d481b9cac', 'c92ab4b9-d08e-4a88-a11e-fb9ea716021e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:00 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:00 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:01 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Deleted volume successfully. Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5276ebbf-4566-43f1-9a88-e70f4df1acb3 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-635bef38-5457-45a3-a518-b09abe04de92-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (efa4a983-ecd9-45ed-ba0f-362a229fd4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f95cf31-c853-4c24-a43f-b91644572dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f95cf31-c853-4c24-a43f-b91644572dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106246084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b062ea-91d7-4e05-91ca-522cdee5053b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:01Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481c4b1d-f765-4fbc-a0e4-9240ca19b266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481c4b1d-f765-4fbc-a0e4-9240ca19b266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ac4254-ce9d-42ac-850b-224b397efdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ac4254-ce9d-42ac-850b-224b397efdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b062ea-91d7-4e05-91ca-522cdee5053b', 'volume_name': 'volume-48b062ea-91d7-4e05-91ca-522cdee5053b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10599c46-3233-466c-bf7b-22e4323b8510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10599c46-3233-466c-bf7b-22e4323b8510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8a2be-c6b7-4e92-bb64-3d174c6c18f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:01 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Volume 48b062ea-91d7-4e05-91ca-522cdee5053b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b062ea-91d7-4e05-91ca-522cdee5053b', 'volume_size': 1} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106246084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b062ea-91d7-4e05-91ca-522cdee5053b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:01Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Creating volume 48b062ea-91d7-4e05-91ca-522cdee5053b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:20:01 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:01 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b 1073741824 Nov 04 19:20:01 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:01 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b 1073741824" returned: 0 in 0.404s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:02 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b Nov 04 19:20:02 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:02 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8a2be-c6b7-4e92-bb64-3d174c6c18f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b062ea-91d7-4e05-91ca-522cdee5053b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b0bb68-f0e4-413e-99d1-0d7495d63b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:02 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Volume volume-48b062ea-91d7-4e05-91ca-522cdee5053b (48b062ea-91d7-4e05-91ca-522cdee5053b): created successfully Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b0bb68-f0e4-413e-99d1-0d7495d63b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (efa4a983-ecd9-45ed-ba0f-362a229fd4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:02 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d866b887-0022-48ac-b65b-22e175e47019 tempest-ProjectReaderTests-2081559958 None] Created volume successfully. Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-48b062ea-91d7-4e05-91ca-522cdee5053b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-48b062ea-91d7-4e05-91ca-522cdee5053b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-quobyte-48b062ea-91d7-4e05-91ca-522cdee5053b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-48b062ea-91d7-4e05-91ca-522cdee5053b" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569fe63-c401-4a5c-8209-e6efce7c9003]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:02 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b Nov 04 19:20:02 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:02 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:03 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b Nov 04 19:20:03 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:03 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-48b062ea-91d7-4e05-91ca-522cdee5053b" returned: 0 in 0.251s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-48b062ea-91d7-4e05-91ca-522cdee5053b" released by "delete_volume" :: held 0.659s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Created reservations ['276f4910-a7d3-41c5-93aa-49d5e0d1d377', '60fd2fd0-e27d-4f96-8548-79edeadf0f31', '6c74fa95-523f-4c1b-9899-69280b109922', 'a140052a-d1c4-4384-8cbc-8ee9f139776a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:03 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:03 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:03 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.268s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Deleted volume successfully. Nov 04 19:20:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e0806410-3794-481d-9d1b-9185b3e9edf9 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-48b062ea-91d7-4e05-91ca-522cdee5053b-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=155,cinder:SELECT=117,cinder:INSERT=40,cinder:DELETE=10 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (e87e54de-885e-4f93-9a00-e85d20ba6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd312b-dfb8-4804-ad8a-20606ecab3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd312b-dfb8-4804-ad8a-20606ecab3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963723571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad154ad4-59ee-4a8d-b077-2b8c2e7907c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:04Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6a934d-3bc4-4cf9-b8eb-88c5dc63bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6a934d-3bc4-4cf9-b8eb-88c5dc63bbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de61893d-8c07-473d-b56f-a0125124e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de61893d-8c07-473d-b56f-a0125124e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad154ad4-59ee-4a8d-b077-2b8c2e7907c0', 'volume_name': 'volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a0b08d-2b71-47f2-8815-876b798858d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a0b08d-2b71-47f2-8815-876b798858d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4860b42e-66f8-400f-8594-8813ea384334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Volume ad154ad4-59ee-4a8d-b077-2b8c2e7907c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0', 'volume_size': 1} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963723571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad154ad4-59ee-4a8d-b077-2b8c2e7907c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0671aa4003c4deb8e3bac7a1c69fa03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:04Z,use_quota=True,user_id='a365617aa0c0421885c3824284211fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Creating volume ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:20:04 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:04 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 1073741824 Nov 04 19:20:04 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:04 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 1073741824" returned: 0 in 0.444s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:04 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 Nov 04 19:20:04 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:05 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4860b42e-66f8-400f-8594-8813ea384334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3f9d84-7416-4a89-89f6-69890c6e5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Volume volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 (ad154ad4-59ee-4a8d-b077-2b8c2e7907c0): created successfully Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3f9d84-7416-4a89-89f6-69890c6e5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Flow 'volume_create_manager' (e87e54de-885e-4f93-9a00-e85d20ba6de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ffdfb098-c56d-4c27-86b1-ffa5ffb46176 tempest-ProjectReaderTests-2081559958 None] Created volume successfully. Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "cinder-quobyte-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[276dbae8-0fe7-4883-a865-7c22515fd014]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:05 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 Nov 04 19:20:05 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:05 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" returned: 0 in 0.389s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0 Nov 04 19:20:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:05 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-quobyte-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0" released by "delete_volume" :: held 0.690s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Created reservations ['bf6b497b-927f-4a41-852a-8ad202027968', 'a3cbe8c3-01cf-4944-ac3a-211ca6f17375', '20de5953-0628-4d45-bdac-4d90c74be430', '91be3929-3865-4eb9-bd6d-c60461b156c7'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:06 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:06 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:06 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Deleted volume successfully. Nov 04 19:20:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-617982b9-02f7-46ef-a16d-f0e8eed75918 tempest-ProjectReaderTests-2081559958 None] Lock "cinder-ad154ad4-59ee-4a8d-b077-2b8c2e7907c0-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:16 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1,cinder:SELECT=7 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:20:16 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=114,cinder:DELETE=11 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:22 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:22 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:22 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:20:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Flow 'volume_create_manager' (996b7aaa-3c76-498c-a78b-a48c693add33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224be34c-be22-4067-8ded-9ff76d5a7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224be34c-be22-4067-8ded-9ff76d5a7019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-320479560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12323ac7-cac9-4187-a63f-8c17453e94f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e67d65094624c0abded3de1d7f6e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:29Z,use_quota=True,user_id='336d15f3dbb6414c973b06bdee4d3348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a5311-9844-4fdc-930c-3752c029c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067a5311-9844-4fdc-930c-3752c029c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555f4177-9c09-4528-9e74-332a47a15d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555f4177-9c09-4528-9e74-332a47a15d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12323ac7-cac9-4187-a63f-8c17453e94f1', 'volume_name': 'volume-12323ac7-cac9-4187-a63f-8c17453e94f1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:28 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2174e-7235-423a-8c47-57dcf697b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2174e-7235-423a-8c47-57dcf697b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791882a-4ad3-4d2a-93ef-ae51bdc9c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Volume 12323ac7-cac9-4187-a63f-8c17453e94f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12323ac7-cac9-4187-a63f-8c17453e94f1', 'volume_size': 1} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-320479560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12323ac7-cac9-4187-a63f-8c17453e94f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e67d65094624c0abded3de1d7f6e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:29Z,use_quota=True,user_id='336d15f3dbb6414c973b06bdee4d3348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Creating volume 12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:20:29 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:29 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 1073741824 Nov 04 19:20:29 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:29 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 1073741824" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:29 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:29 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:29 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.237s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791882a-4ad3-4d2a-93ef-ae51bdc9c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12323ac7-cac9-4187-a63f-8c17453e94f1', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdecc14-4cf1-42af-9a35-457a342caff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:29 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Volume volume-12323ac7-cac9-4187-a63f-8c17453e94f1 (12323ac7-cac9-4187-a63f-8c17453e94f1): created successfully Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdecc14-4cf1-42af-9a35-457a342caff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:29 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Flow 'volume_create_manager' (996b7aaa-3c76-498c-a78b-a48c693add33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2ec8fc72-aa32-4eb0-9c31-a3f4dbe8e086 tempest-SnapshotDependencyTests-1538891719 None] Created volume successfully. Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Creating offline snapshot 8a6d1413-0109-47c5-b464-14410fd063e4 of volume 12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458283d-b902-4ec8-8556-b76ad3bea335]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:30 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:30 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:30 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:30 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 1G Nov 04 19:20:30 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:30 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 1G" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12323ac7-cac9-4187-a63f-8c17453e94f1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:30 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12323ac7-cac9-4187-a63f-8c17453e94f1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:30 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:31 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12323ac7-cac9-4187-a63f-8c17453e94f1 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:31 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 is being set with open permissions: ugo+rw Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:31 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:31 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:31 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:31 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info Nov 04 19:20:31 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:31 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:31 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info is being set with open permissions: ugo+rw Nov 04 19:20:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:31 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info Nov 04 19:20:31 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:32 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.info" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-210ab1d2-05c8-45ca-9256-4b882586bd89 tempest-SnapshotDependencyTests-1538891719 None] Create snapshot completed successfully Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Flow 'volume_create_manager' (7d4d841d-a432-42a4-a3c8-cb552696c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba52f70-6d29-4cd7-ad6d-02305cdddbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba52f70-6d29-4cd7-ad6d-02305cdddbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e852eb-f36f-4d59-b775-f8b9c7770427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e67d65094624c0abded3de1d7f6e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a6d1413-0109-47c5-b464-14410fd063e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:20:33Z,use_quota=True,user_id='336d15f3dbb6414c973b06bdee4d3348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c6ccd-aae4-416f-a81e-539805208dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c6ccd-aae4-416f-a81e-539805208dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd9200b-d89b-4c51-9da6-79f08cbefd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd9200b-d89b-4c51-9da6-79f08cbefd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31e852eb-f36f-4d59-b775-f8b9c7770427', 'volume_name': 'volume-31e852eb-f36f-4d59-b775-f8b9c7770427', 'volume_size': 1, 'snapshot_id': '8a6d1413-0109-47c5-b464-14410fd063e4'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cdb7bf-9e71-4c45-b0b5-01d3231bd789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cdb7bf-9e71-4c45-b0b5-01d3231bd789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200fb31f-ae7c-43e7-9a16-91106951ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:32 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Volume 31e852eb-f36f-4d59-b775-f8b9c7770427: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31e852eb-f36f-4d59-b775-f8b9c7770427', 'volume_size': 1, 'snapshot_id': '8a6d1413-0109-47c5-b464-14410fd063e4'} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4-31e852eb-f36f-4d59-b775-f8b9c7770427" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4-31e852eb-f36f-4d59-b775-f8b9c7770427" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Creating volume 31e852eb-f36f-4d59-b775-f8b9c7770427 from snapshot 8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] snapshot: 8a6d1413-0109-47c5-b464-14410fd063e4, volume: 31e852eb-f36f-4d59-b775-f8b9c7770427, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b1bdf-de01-4bcc-823b-e7048dced75a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:33 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:33 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:33 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12323ac7-cac9-4187-a63f-8c17453e94f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2140abf9-2c67-4522-b71a-49dce7a5f48a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:33 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:33 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:33 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.362s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:20:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:33 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 Nov 04 19:20:33 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:39 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427" returned: 0 in 5.822s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:20:39 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Converted 1024.00 MB image at 175.84 MB/s Nov 04 19:20:39 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 is being set with open permissions: ugo+rw Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:39 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 Nov 04 19:20:39 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:39 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" released by "_copy_volume_from_snapshot" :: held 6.863s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4-31e852eb-f36f-4d59-b775-f8b9c7770427" released by "_create_volume_from_snapshot" :: held 6.923s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.938s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200fb31f-ae7c-43e7-9a16-91106951ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e852eb-f36f-4d59-b775-f8b9c7770427', 'volume_size': 1, 'snapshot_id': '8a6d1413-0109-47c5-b464-14410fd063e4'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff1eb1c-d9a4-4858-b17e-5a7fd8c852c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:20:39 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Volume volume-31e852eb-f36f-4d59-b775-f8b9c7770427 (31e852eb-f36f-4d59-b775-f8b9c7770427): created successfully Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff1eb1c-d9a4-4858-b17e-5a7fd8c852c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:20:39 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Flow 'volume_create_manager' (7d4d841d-a432-42a4-a3c8-cb552696c568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:20:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b1fdc707-0840-49b1-8081-a01e8240e6b9 tempest-SnapshotDependencyTests-1538891719 None] Created volume successfully. Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-8a6d1413-0109-47c5-b464-14410fd063e4-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-8a6d1413-0109-47c5-b464-14410fd063e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Deleting offline snapshot 8a6d1413-0109-47c5-b464-14410fd063e4 of volume 12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] snapshot_file for this snap is: volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[611cc897-8702-44c9-aded-b1a0d67f3279]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:40 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:40 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:40 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12323ac7-cac9-4187-a63f-8c17453e94f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f432daf8-9d77-4bea-b259-c1b79a065293]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:41 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:41 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:41 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.522s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:41 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:41 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:41 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:41 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4 Nov 04 19:20:41 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:42 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1.8a6d1413-0109-47c5-b464-14410fd063e4" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-8a6d1413-0109-47c5-b464-14410fd063e4" released by "_delete_snapshot" :: held 1.558s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" released by "delete_snapshot" :: held 1.580s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Created reservations ['46015f45-b747-41fa-ad0f-38bdc02d7a1a', '75cd7e21-9257-469f-b6b1-59c2c4ae6643', '6b846141-4e23-4608-a5d1-d50ed38c0669', '6f55cca6-16ad-4dfe-b46f-e91c300a32f1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:42 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Delete snapshot completed successfully. Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7d9bdec5-3dfa-4f20-836e-4cf020d38003 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-8a6d1413-0109-47c5-b464-14410fd063e4-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-12323ac7-cac9-4187-a63f-8c17453e94f1-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-12323ac7-cac9-4187-a63f-8c17453e94f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a1d49c-0962-48fd-ac4b-dda32c228bf4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:42 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:42 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:43 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:43 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1 Nov 04 19:20:43 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:43 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12323ac7-cac9-4187-a63f-8c17453e94f1" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-12323ac7-cac9-4187-a63f-8c17453e94f1" released by "delete_volume" :: held 0.657s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Created reservations ['cc7caec6-7b9a-4ecc-b333-482550e76351', 'b1893d93-c6e8-42b0-bc55-18d9b73c07a3', 'eeb146b0-cc57-443b-a5a2-a404fbbf1ed2', '026f1a3c-e129-4c79-9918-0f9b5bd882cb'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:43 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:43 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:43 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Deleted volume successfully. Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d9e59710-6722-4f3d-a323-9706ce79eed6 tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-12323ac7-cac9-4187-a63f-8c17453e94f1-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-31e852eb-f36f-4d59-b775-f8b9c7770427-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-31e852eb-f36f-4d59-b775-f8b9c7770427-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" acquired by "delete_volume" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5816f9ce-21ca-4f29-a5cd-4b3d230b89c7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:20:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:43 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 Nov 04 19:20:43 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:44 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427" returned: 0 in 0.357s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:44 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427 Nov 04 19:20:44 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:44 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-31e852eb-f36f-4d59-b775-f8b9c7770427" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-quobyte-31e852eb-f36f-4d59-b775-f8b9c7770427" released by "delete_volume" :: held 0.649s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Created reservations ['091928ed-41ae-4cd5-8586-cd46261e1438', '156152c9-b84b-440c-b63b-5a4fc217f248', '4aa0e4bc-6ab4-462d-9ac8-6e6c2b93d005', '6a30eb10-3505-419d-bbec-6a09aeebe126'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:20:44 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:20:44 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:20:44 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:20:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Deleted volume successfully. Nov 04 19:20:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-00e7c891-861e-40b0-9f44-a5be6e5f0e7f tempest-SnapshotDependencyTests-1538891719 None] Lock "cinder-31e852eb-f36f-4d59-b775-f8b9c7770427-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:20:54 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:20:54 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (5159d741-b64a-425d-a00f-5e4d851505f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b92d3-8e6c-480b-a0b5-831bed091591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619b92d3-8e6c-480b-a0b5-831bed091591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379480360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698cb782-08ce-45f7-ab38-55ea1e49b97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:05Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4cab14-9ddd-4d5d-bb25-aa6403d73efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4cab14-9ddd-4d5d-bb25-aa6403d73efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc2f4f1-8656-4bec-b85e-1ba4ca1a5ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc2f4f1-8656-4bec-b85e-1ba4ca1a5ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698cb782-08ce-45f7-ab38-55ea1e49b97d', 'volume_name': 'volume-698cb782-08ce-45f7-ab38-55ea1e49b97d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be148c23-d669-4ad0-906e-89a27d28615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be148c23-d669-4ad0-906e-89a27d28615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e8615-21dd-4b89-859c-9c8206a0bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume 698cb782-08ce-45f7-ab38-55ea1e49b97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698cb782-08ce-45f7-ab38-55ea1e49b97d', 'volume_size': 1} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379480360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698cb782-08ce-45f7-ab38-55ea1e49b97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:05Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume 698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:04 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:05 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d 1073741824 Nov 04 19:21:05 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (f538af83-4c65-468f-90f4-4019274861f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cda94b-0838-42ca-87d7-2e14bf0d6d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cda94b-0838-42ca-87d7-2e14bf0d6d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937287691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152e4a7b-78bb-407c-a3dd-82d666817e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:05Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76ac6a8-ea5f-48a7-93df-cc8ff7b43d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76ac6a8-ea5f-48a7-93df-cc8ff7b43d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7277e4-30ef-4227-bfaf-d1cbb1e85d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7277e4-30ef-4227-bfaf-d1cbb1e85d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152e4a7b-78bb-407c-a3dd-82d666817e89', 'volume_name': 'volume-152e4a7b-78bb-407c-a3dd-82d666817e89', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f84e4-1f96-4a6f-8795-008e046e9c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f84e4-1f96-4a6f-8795-008e046e9c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74187e7-d03b-4d96-afe1-77e8fab335f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Volume 152e4a7b-78bb-407c-a3dd-82d666817e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152e4a7b-78bb-407c-a3dd-82d666817e89', 'volume_size': 1} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:05 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (ba6a5806-ae11-4c04-89c9-d12ca2024ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c89509-2e10-4c15-bedf-b862b6b0f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d 1073741824" returned: 0 in 0.704s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c89509-2e10-4c15-bedf-b862b6b0f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237996824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4352d4-b559-411c-bd8a-8e9a38ffe26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4352d4-b559-411c-bd8a-8e9a38ffe26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9281cbf-6ef3-41a3-9017-72f523b77988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9281cbf-6ef3-41a3-9017-72f523b77988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3', 'volume_name': 'volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692f3c56-559a-4aea-9b45-723fc34e6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692f3c56-559a-4aea-9b45-723fc34e6e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfd747a-503c-4f21-8e96-3e5608b46aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Volume 9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3', 'volume_size': 1} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:05 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d Nov 04 19:21:05 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:06 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d" returned: 0 in 0.290s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.881s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937287691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152e4a7b-78bb-407c-a3dd-82d666817e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:05Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Creating volume 152e4a7b-78bb-407c-a3dd-82d666817e89 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:06 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 1073741824 Nov 04 19:21:06 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e8615-21dd-4b89-859c-9c8206a0bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698cb782-08ce-45f7-ab38-55ea1e49b97d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f719a5-d2fe-47a8-9647-917f4235288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-698cb782-08ce-45f7-ab38-55ea1e49b97d (698cb782-08ce-45f7-ab38-55ea1e49b97d): created successfully Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f719a5-d2fe-47a8-9647-917f4235288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (5159d741-b64a-425d-a00f-5e4d851505f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-694fbece-d6a8-4c9f-b0fe-08d86866e9a6 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (1216d1d5-697c-423a-a9a9-1c3b12946bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4266938e-fc9c-41b0-aa01-dbff56238a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4266938e-fc9c-41b0-aa01-dbff56238a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129397755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d461e104-43d9-4aa5-a82a-551f8f53e504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9421f-18b9-4315-b108-72a8be67f843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9421f-18b9-4315-b108-72a8be67f843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bce99e-39e8-436b-b53b-2bc2cf22804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bce99e-39e8-436b-b53b-2bc2cf22804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd461e104-43d9-4aa5-a82a-551f8f53e504', 'volume_name': 'volume-d461e104-43d9-4aa5-a82a-551f8f53e504', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799505b-f91a-4b9c-84b1-e0587c15716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799505b-f91a-4b9c-84b1-e0587c15716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d681012-a440-4546-bdef-ab3be06d9149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Volume d461e104-43d9-4aa5-a82a-551f8f53e504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d461e104-43d9-4aa5-a82a-551f8f53e504', 'volume_size': 1} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (5535d369-f6b4-4082-90b9-c6ef2600115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1760e646-4c26-42fb-84e3-d26971680d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1760e646-4c26-42fb-84e3-d26971680d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-663678606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e70e7d-bfa6-43a6-9f22-84166f8bbda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a5c6c-16d1-4e4e-99be-b6287bc013e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6a5c6c-16d1-4e4e-99be-b6287bc013e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c00856-9fdc-4ce8-8bbd-18521e830358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c00856-9fdc-4ce8-8bbd-18521e830358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e70e7d-bfa6-43a6-9f22-84166f8bbda4', 'volume_name': 'volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c12eaf-3b0d-4482-9aaf-1dd63a61ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c12eaf-3b0d-4482-9aaf-1dd63a61ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76e0a3d-cfdc-4619-9f92-14f3fbedac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume 28e70e7d-bfa6-43a6-9f22-84166f8bbda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4', 'volume_size': 1} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (a0190f02-8f97-4044-8f03-f2b238b8996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de11be4-0f1c-4e45-b297-45d619d72436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de11be4-0f1c-4e45-b297-45d619d72436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140858956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3538ac-544c-4230-bb6e-85fb60da503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:07Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f198f276-b2bb-4d86-80ac-dceb5108abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f198f276-b2bb-4d86-80ac-dceb5108abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647eedb4-8837-440b-9635-5c7b85f2f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647eedb4-8837-440b-9635-5c7b85f2f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3538ac-544c-4230-bb6e-85fb60da503e', 'volume_name': 'volume-2e3538ac-544c-4230-bb6e-85fb60da503e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426e936-ac79-4894-8053-c41db1347e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0426e936-ac79-4894-8053-c41db1347e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5608fcad-a6e0-4b96-b4f1-9e38ad85949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:06 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Volume 2e3538ac-544c-4230-bb6e-85fb60da503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3538ac-544c-4230-bb6e-85fb60da503e', 'volume_size': 1} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:06 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 1073741824" returned: 0 in 0.728s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:06 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 Nov 04 19:21:06 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:06 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (b7d7a46f-09a4-4dcd-96d2-b0829168e9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b03a7-f31d-4f93-9079-a73bfb30500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233b03a7-f31d-4f93-9079-a73bfb30500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954237282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dce84c9-cc35-43fe-b3a8-fdce78954363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:07Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076619be-ee91-4e68-aa20-996fd2f443cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076619be-ee91-4e68-aa20-996fd2f443cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52d669d-63bb-4350-8edb-aa2b842fb9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52d669d-63bb-4350-8edb-aa2b842fb9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dce84c9-cc35-43fe-b3a8-fdce78954363', 'volume_name': 'volume-4dce84c9-cc35-43fe-b3a8-fdce78954363', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a677f96-5d9a-400e-bbe2-04a389929a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a677f96-5d9a-400e-bbe2-04a389929a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f00c1ba-2c49-44ea-8033-c222b16d2ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Volume 4dce84c9-cc35-43fe-b3a8-fdce78954363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dce84c9-cc35-43fe-b3a8-fdce78954363', 'volume_size': 1} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:07 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237996824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Creating volume 9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74187e7-d03b-4d96-afe1-77e8fab335f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152e4a7b-78bb-407c-a3dd-82d666817e89', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5980f7fe-a48d-4789-bee9-3b68fad160d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:07 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 1073741824 Nov 04 19:21:07 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Volume volume-152e4a7b-78bb-407c-a3dd-82d666817e89 (152e4a7b-78bb-407c-a3dd-82d666817e89): created successfully Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5980f7fe-a48d-4789-bee9-3b68fad160d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (f538af83-4c65-468f-90f4-4019274861f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:07 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-76f64732-3590-48c5-bd98-f1abefecc082 tempest-CreateVolumesFromImageTest-826904627 None] Created volume successfully. Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:07 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 1073741824" returned: 0 in 0.512s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:07 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 Nov 04 19:21:07 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:07 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129397755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d461e104-43d9-4aa5-a82a-551f8f53e504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Creating volume d461e104-43d9-4aa5-a82a-551f8f53e504 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfd747a-503c-4f21-8e96-3e5608b46aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:08 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 1073741824 Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4998ed6a-163a-4027-b7e5-490c1d3e8a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:08 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Volume volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 (9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3): created successfully Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4998ed6a-163a-4027-b7e5-490c1d3e8a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (ba6a5806-ae11-4c04-89c9-d12ca2024ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9dba7367-605b-44cc-a954-70bc00f70724 tempest-CreateVolumesFromImageTest-826904627 None] Created volume successfully. Nov 04 19:21:08 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 1073741824" returned: 0 in 0.432s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:08 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 Nov 04 19:21:08 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:08 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.029s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-663678606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e70e7d-bfa6-43a6-9f22-84166f8bbda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:06Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume 28e70e7d-bfa6-43a6-9f22-84166f8bbda4 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d681012-a440-4546-bdef-ab3be06d9149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d461e104-43d9-4aa5-a82a-551f8f53e504', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:08 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 1073741824 Nov 04 19:21:08 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6563ca-0147-4571-9eda-1bc8448f0291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Volume volume-d461e104-43d9-4aa5-a82a-551f8f53e504 (d461e104-43d9-4aa5-a82a-551f8f53e504): created successfully Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6563ca-0147-4571-9eda-1bc8448f0291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (1216d1d5-697c-423a-a9a9-1c3b12946bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e14b2811-a7ea-471b-b963-9e8c60c2976e tempest-CreateVolumesFromImageTest-826904627 None] Created volume successfully. Nov 04 19:21:09 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 1073741824" returned: 0 in 0.519s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:09 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 Nov 04 19:21:09 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:09 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.742s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2140858956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3538ac-544c-4230-bb6e-85fb60da503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:07Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Creating volume 2e3538ac-544c-4230-bb6e-85fb60da503e {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:09 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:09 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e 1073741824 Nov 04 19:21:09 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76e0a3d-cfdc-4619-9f92-14f3fbedac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a51e610-4c44-4e05-98e3-ec9759dea95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 (28e70e7d-bfa6-43a6-9f22-84166f8bbda4): created successfully Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a51e610-4c44-4e05-98e3-ec9759dea95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (5535d369-f6b4-4082-90b9-c6ef2600115d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c1758b6a-34ab-4246-bdbf-cc880a3b86bc tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Flow 'volume_create_manager' (c9d9c5c5-f29b-45c2-98c0-f817bb2b28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052f85c0-de46-4d80-9461-08e49333aea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052f85c0-de46-4d80-9461-08e49333aea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650d53aa-f165-4146-9d7b-3f1272480949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a111942c4484177aa9f9393266292cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:10Z,use_quota=True,user_id='727318ece8534b6598cb2afa3c7b093e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca68c66c-9116-4c3f-b2d4-827a0b013f25),volume_type_id=ca68c66c-9116-4c3f-b2d4-827a0b013f25)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91689dc-aa0c-463e-973a-48dc888190e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91689dc-aa0c-463e-973a-48dc888190e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11467283-2ba7-48e8-bf10-6530d1f8868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:09 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:21:10 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e 1073741824" returned: 0 in 0.488s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11467283-2ba7-48e8-bf10-6530d1f8868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '650d53aa-f165-4146-9d7b-3f1272480949', 'volume_name': 'volume-650d53aa-f165-4146-9d7b-3f1272480949', 'volume_size': 1, 'image_id': 'b695c641-75a9-44db-a0f6-42c125387978', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf40a147c6a6629b60af056793795491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a111942c4484177aa9f9393266292cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e13ed951db64f401e2a69fbf5e090f62784781186a5694dc4efa2009c12df0bfab8e477149038956219c5c030191f1c7cd03f541f8938d5188ab0ad77ff2fa98', 'id': 'b695c641-75a9-44db-a0f6-42c125387978', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b695c641-75a9-44db-a0f6-42c125387978/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851620a0-3898-4681-8887-86ddc8302bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851620a0-3898-4681-8887-86ddc8302bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b996a-8b2a-4541-b740-5ccdbf8e16ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Volume 650d53aa-f165-4146-9d7b-3f1272480949: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-650d53aa-f165-4146-9d7b-3f1272480949', 'volume_size': 1, 'image_id': 'b695c641-75a9-44db-a0f6-42c125387978', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf40a147c6a6629b60af056793795491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a111942c4484177aa9f9393266292cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e13ed951db64f401e2a69fbf5e090f62784781186a5694dc4efa2009c12df0bfab8e477149038956219c5c030191f1c7cd03f541f8938d5188ab0ad77ff2fa98', 'id': 'b695c641-75a9-44db-a0f6-42c125387978', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b695c641-75a9-44db-a0f6-42c125387978/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Trying to clone 650d53aa-f165-4146-9d7b-3f1272480949 from image b695c641-75a9-44db-a0f6-42c125387978 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:10 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e Nov 04 19:21:10 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:21:10 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[76646490-20c3-41fb-b373-02ba8e7e642d]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:10 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:10 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:10 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e" returned: 0 in 0.284s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.342s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954237282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dce84c9-cc35-43fe-b3a8-fdce78954363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4600c62d35da4b6ca425ac6cbb9f9d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:07Z,use_quota=True,user_id='8e444800220c4cc18d081482074de234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Creating volume 4dce84c9-cc35-43fe-b3a8-fdce78954363 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:10 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5608fcad-a6e0-4b96-b4f1-9e38ad85949f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3538ac-544c-4230-bb6e-85fb60da503e', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:10 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 1073741824 Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caefee3f-3c96-41c7-9779-f04e74d3fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:10 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:10 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Volume volume-2e3538ac-544c-4230-bb6e-85fb60da503e (2e3538ac-544c-4230-bb6e-85fb60da503e): created successfully Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caefee3f-3c96-41c7-9779-f04e74d3fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (a0190f02-8f97-4044-8f03-f2b238b8996a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b21505e4-6c6d-498a-9b2a-1de60cc2e3ae tempest-CreateVolumesFromImageTest-826904627 None] Created volume successfully. Nov 04 19:21:10 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:10 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:10 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:10 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Temporary image b695c641-75a9-44db-a0f6-42c125387978 is fetched for user 727318ece8534b6598cb2afa3c7b093e. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:21:10 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 1073741824" returned: 0 in 0.558s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (908da890-9ee8-4072-a70d-1e5ad3d608db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e831856-8f69-4fda-bc89-5b1e9029c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a735a02-cdc8-4cf9-a523-9742aadd7c17]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e831856-8f69-4fda-bc89-5b1e9029c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1895638524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d00082-f8b0-44f7-ab65-267354456fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:11Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb88645-0353-4259-ac31-110b836e9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb88645-0353-4259-ac31-110b836e9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8358de2c-0d66-4494-a046-2d538ab27d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8358de2c-0d66-4494-a046-2d538ab27d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d00082-f8b0-44f7-ab65-267354456fc7', 'volume_name': 'volume-97d00082-f8b0-44f7-ab65-267354456fc7', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a9bd84-6300-48ba-aadc-df53aa764071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a9bd84-6300-48ba-aadc-df53aa764071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e862b2f7-e2fc-459c-af4b-5b5459d5622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume 97d00082-f8b0-44f7-ab65-267354456fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d00082-f8b0-44f7-ab65-267354456fc7', 'volume_size': 1} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:11 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 Nov 04 19:21:11 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:11 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:11 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:11 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.962s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:11 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating offline snapshot fbb15a3a-9828-4b99-860e-645d0dd9ba56 of volume 698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f00c1ba-2c49-44ea-8033-c222b16d2ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dce84c9-cc35-43fe-b3a8-fdce78954363', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a3560f-2dc2-4bb9-aedb-9b14f539bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366c5f0-5d5f-4a2d-83b0-ce4ccf85867b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Volume volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 (4dce84c9-cc35-43fe-b3a8-fdce78954363): created successfully Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a3560f-2dc2-4bb9-aedb-9b14f539bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Flow 'volume_create_manager' (b7d7a46f-09a4-4dcd-96d2-b0829168e9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fd737396-cf68-49da-aa90-761c12684488 tempest-CreateVolumesFromImageTest-826904627 None] Created volume successfully. Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:11 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:11 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (b53d7c0a-6b6e-4d81-b746-a95476ee363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5256ce5a-662f-43f1-96a0-ab0ab3671afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5256ce5a-662f-43f1-96a0-ab0ab3671afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031756497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4745789-aa88-4d0a-a44f-1e4345047418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:12Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf614d-6d72-46a2-a141-03161174032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaf614d-6d72-46a2-a141-03161174032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76383618-cb38-42c2-a35f-216eebae97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76383618-cb38-42c2-a35f-216eebae97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4745789-aa88-4d0a-a44f-1e4345047418', 'volume_name': 'volume-b4745789-aa88-4d0a-a44f-1e4345047418', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927ca497-6764-4dd0-9d9b-4e22cbe130dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927ca497-6764-4dd0-9d9b-4e22cbe130dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86054a34-c77b-4dfe-bac7-ca604e1c5c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:11 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume b4745789-aa88-4d0a-a44f-1e4345047418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4745789-aa88-4d0a-a44f-1e4345047418', 'volume_size': 1} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:11 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d Nov 04 19:21:11 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:11 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:12 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:12 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 1G Nov 04 19:21:12 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (2df1d2cb-370f-467c-ba17-9ed87a5069aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c68731a-4352-4245-8f88-2a5babf4f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c68731a-4352-4245-8f88-2a5babf4f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881106366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c560f-a9c0-4862-8580-98b635f51dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:12Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f52b0e-79eb-4108-89df-3dcf22caa62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f52b0e-79eb-4108-89df-3dcf22caa62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ff610-7381-4e39-bae3-07a800a4cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ff610-7381-4e39-bae3-07a800a4cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988c560f-a9c0-4862-8580-98b635f51dbe', 'volume_name': 'volume-988c560f-a9c0-4862-8580-98b635f51dbe', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fb9cc8-be51-4e0d-b886-147bb0cbe936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fb9cc8-be51-4e0d-b886-147bb0cbe936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c4d83-aff1-460b-bda4-c00b9e6c345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume 988c560f-a9c0-4862-8580-98b635f51dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988c560f-a9c0-4862-8580-98b635f51dbe', 'volume_size': 1} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:12 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 1G" returned: 0 in 0.471s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698cb782-08ce-45f7-ab38-55ea1e49b97d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:12 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698cb782-08ce-45f7-ab38-55ea1e49b97d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 Nov 04 19:21:12 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-4dce84c9-cc35-43fe-b3a8-fdce78954363-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-4dce84c9-cc35-43fe-b3a8-fdce78954363-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-quobyte-4dce84c9-cc35-43fe-b3a8-fdce78954363" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (5a5eb173-3428-4853-bdd6-bfa2ffd1e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca12e3bb-c53e-42cf-8054-a90208010b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-4dce84c9-cc35-43fe-b3a8-fdce78954363" acquired by "delete_volume" :: waited 0.060s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9f80a-edca-4b24-91eb-f029d9867dec]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca12e3bb-c53e-42cf-8054-a90208010b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747069826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d712de6-c031-40db-9d28-171a0f65ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:13Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d604cd6-a41d-4461-bdb4-4135e6fe8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d604cd6-a41d-4461-bdb4-4135e6fe8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee24d000-42a7-48a2-97f8-4a9ab8e0b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee24d000-42a7-48a2-97f8-4a9ab8e0b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d712de6-c031-40db-9d28-171a0f65ac17', 'volume_name': 'volume-4d712de6-c031-40db-9d28-171a0f65ac17', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e9deaf-e1c1-424b-8b8a-86efa2c99bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e9deaf-e1c1-424b-8b8a-86efa2c99bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5e9daf-1751-4ecd-8c9c-f4ebdd278103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:12 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume 4d712de6-c031-40db-9d28-171a0f65ac17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d712de6-c031-40db-9d28-171a0f65ac17', 'volume_size': 1} Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:12 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698cb782-08ce-45f7-ab38-55ea1e49b97d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56" returned: 0 in 0.434s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:12 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 is being set with open permissions: ugo+rw Nov 04 19:21:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:12 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 Nov 04 19:21:12 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 Nov 04 19:21:13 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (94889d06-ec4c-42d3-9653-e592bf9f6a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936f6f81-6859-4221-b470-ac1763e71c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936f6f81-6859-4221-b470-ac1763e71c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747202664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c72c24-cc26-44df-a01f-970db7013983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:13Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597f9de-9c2f-458d-8f99-80bc6631063e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1597f9de-9c2f-458d-8f99-80bc6631063e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc970164-e834-4a07-85c4-033ae0e56941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc970164-e834-4a07-85c4-033ae0e56941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c72c24-cc26-44df-a01f-970db7013983', 'volume_name': 'volume-c3c72c24-cc26-44df-a01f-970db7013983', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460f7326-9fe3-4f95-862b-349c299697b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:13 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460f7326-9fe3-4f95-862b-349c299697b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14d3c09-3510-494e-98b9-c0d306f96674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume c3c72c24-cc26-44df-a01f-970db7013983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c72c24-cc26-44df-a01f-970db7013983', 'volume_size': 1} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56" returned: 0 in 0.273s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:13 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:13 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info Nov 04 19:21:13 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363 Nov 04 19:21:13 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info is being set with open permissions: ugo+rw Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:13 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4dce84c9-cc35-43fe-b3a8-fdce78954363" returned: 0 in 0.263s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info Nov 04 19:21:13 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-4dce84c9-cc35-43fe-b3a8-fdce78954363" released by "delete_volume" :: held 0.759s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Created reservations ['4e44e5bf-6459-43cd-a1ee-3a78ff51c41d', '6d55eb9d-334d-48d5-a024-6f0c153eccb7', '0bdafb0b-e2cb-4a09-9c4e-53a2ab0f4fef', '7d842e6d-22a8-4eb7-af93-ba868f6662af'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:13 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:13 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.info" returned: 0 in 0.276s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.641s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1895638524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d00082-f8b0-44f7-ab65-267354456fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:11Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume 97d00082-f8b0-44f7-ab65-267354456fc7 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:13 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:13 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 1073741824 Nov 04 19:21:13 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-2e3538ac-544c-4230-bb6e-85fb60da503e-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3891d156-8a66-4476-a5a0-47264eb25fee tempest-CreateVolumesFromSnapshotTest-2112838884 None] Create snapshot completed successfully Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-2e3538ac-544c-4230-bb6e-85fb60da503e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:13 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Deleted volume successfully. Nov 04 19:21:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-quobyte-2e3538ac-544c-4230-bb6e-85fb60da503e" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-48282d1f-bed9-46a8-b292-f79f7ddde292 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-4dce84c9-cc35-43fe-b3a8-fdce78954363-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-2e3538ac-544c-4230-bb6e-85fb60da503e" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d9bbc-1195-40bd-a234-35e3cdb9cdce]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:14 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e Nov 04 19:21:14 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:14 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 1073741824" returned: 0 in 0.480s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:14 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 Nov 04 19:21:14 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:14 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e" returned: 0 in 0.422s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:14 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e Nov 04 19:21:14 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:14 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7" returned: 0 in 0.290s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.917s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031756497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4745789-aa88-4d0a-a44f-1e4345047418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:12Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume b4745789-aa88-4d0a-a44f-1e4345047418 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:14 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:14 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 1073741824 Nov 04 19:21:14 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e862b2f7-e2fc-459c-af4b-5b5459d5622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d00082-f8b0-44f7-ab65-267354456fc7', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:14 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee603f01-8a9b-4868-af26-ed562fa45826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2e3538ac-544c-4230-bb6e-85fb60da503e" returned: 0 in 0.273s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-2e3538ac-544c-4230-bb6e-85fb60da503e" released by "delete_volume" :: held 0.746s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-97d00082-f8b0-44f7-ab65-267354456fc7 (97d00082-f8b0-44f7-ab65-267354456fc7): created successfully Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee603f01-8a9b-4868-af26-ed562fa45826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (908da890-9ee8-4072-a70d-1e5ad3d608db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6a7edb8a-bcab-4664-8f63-915ccef8871b tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Created reservations ['0ba521b0-301c-48e1-85aa-d79278f54df2', 'aeefb808-0d46-4b17-9134-3cb23e2c7b8d', 'a70585d5-f676-4f75-89f9-b4fcdd4e4e35', '0092f26a-7da4-47b2-b4a3-424d5aeae790'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:14 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:14 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-d461e104-43d9-4aa5-a82a-551f8f53e504-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-d461e104-43d9-4aa5-a82a-551f8f53e504-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-quobyte-d461e104-43d9-4aa5-a82a-551f8f53e504" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-d461e104-43d9-4aa5-a82a-551f8f53e504" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:15 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.289s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4b509d-ee4c-4fc8-abd1-8b0142eea356]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Deleted volume successfully. Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3bf955cb-3cc3-450a-8a11-bc5314a4ae51 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-2e3538ac-544c-4230-bb6e-85fb60da503e-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:15 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 1073741824" returned: 0 in 0.599s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:15 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 Nov 04 19:21:15 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:15 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 Nov 04 19:21:15 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:15 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.744s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650d53aa-f165-4146-9d7b-3f1272480949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a111942c4484177aa9f9393266292cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:10Z,use_quota=True,user_id='727318ece8534b6598cb2afa3c7b093e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca68c66c-9116-4c3f-b2d4-827a0b013f25),volume_type_id=ca68c66c-9116-4c3f-b2d4-827a0b013f25)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Creating volume 650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:15 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:15 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504" returned: 0 in 0.498s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:15 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1073741824 Nov 04 19:21:15 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86054a34-c77b-4dfe-bac7-ca604e1c5c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4745789-aa88-4d0a-a44f-1e4345047418', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751562a1-6f2c-4985-8806-149b1059f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:15 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504 Nov 04 19:21:15 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (4e36e20b-febc-460e-b829-1e5088c2990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e03656-1d6c-47c1-be3d-88b6cf1511a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-b4745789-aa88-4d0a-a44f-1e4345047418 (b4745789-aa88-4d0a-a44f-1e4345047418): created successfully Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751562a1-6f2c-4985-8806-149b1059f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (b53d7c0a-6b6e-4d81-b746-a95476ee363c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e03656-1d6c-47c1-be3d-88b6cf1511a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932217140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a13ee6-d289-4f89-974b-5c14681dba36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:16Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac14dce3-1df3-4903-8b8f-cb19cb6db1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac14dce3-1df3-4903-8b8f-cb19cb6db1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362a05ea-7b64-4484-896f-8ae5ad416f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362a05ea-7b64-4484-896f-8ae5ad416f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a13ee6-d289-4f89-974b-5c14681dba36', 'volume_name': 'volume-89a13ee6-d289-4f89-974b-5c14681dba36', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800d41f-4045-458a-923d-df370bac1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800d41f-4045-458a-923d-df370bac1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e094de7-1966-4337-9737-b389abba393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:15 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume 89a13ee6-d289-4f89-974b-5c14681dba36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a13ee6-d289-4f89-974b-5c14681dba36', 'volume_size': 1} Nov 04 19:21:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5d0109b2-789b-4ac2-b3f6-0839e6df90b4 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:16 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d461e104-43d9-4aa5-a82a-551f8f53e504" returned: 0 in 0.360s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-d461e104-43d9-4aa5-a82a-551f8f53e504" released by "delete_volume" :: held 0.942s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Created reservations ['d9be6221-27d4-4415-86af-779c0ecb5b33', 'f03c91e1-a5dc-49a9-9b94-4c763b9748fa', '3c43c625-4025-437f-ad9e-9151c651e7f1', 'e1e073a2-9295-46c8-b598-666dca2e1d74'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (ee06cbf4-40a5-4b53-bef5-5beb5f1603a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3c1122-598c-42a7-a621-ade02252c1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1073741824" returned: 0 in 0.653s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3c1122-598c-42a7-a621-ade02252c1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664907738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe3acec-37c5-4678-a2be-f101abc068fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:16Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5da51-e5e8-40ed-880a-381e328ff10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5da51-e5e8-40ed-880a-381e328ff10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0766df29-8982-4ac8-9775-ee3eb32727e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0766df29-8982-4ac8-9775-ee3eb32727e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe3acec-37c5-4678-a2be-f101abc068fb', 'volume_name': 'volume-bbe3acec-37c5-4678-a2be-f101abc068fb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b955761-798e-4d2f-9f27-3713ff2c7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b955761-798e-4d2f-9f27-3713ff2c7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcec617-d1f0-488d-9121-12aa08647c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume bbe3acec-37c5-4678-a2be-f101abc068fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe3acec-37c5-4678-a2be-f101abc068fb', 'volume_size': 1} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:16 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 Nov 04 19:21:16 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:16 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:16 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-quobyte-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" acquired by "delete_volume" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090f57a-8aa7-49fc-82b7-9c4e25bf0b42]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (13a69d94-23ff-4355-9467-2b9f7cbbe246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720fc4a-05c3-4653-9427-41710c48bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720fc4a-05c3-4653-9427-41710c48bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910685428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42807bc-eeab-48f2-8668-7416be26873f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:17Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a4ce4e-d926-4544-9976-f761f494fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a4ce4e-d926-4544-9976-f761f494fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10657eb7-e30f-4770-b31d-b6f9a7165531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10657eb7-e30f-4770-b31d-b6f9a7165531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c42807bc-eeab-48f2-8668-7416be26873f', 'volume_name': 'volume-c42807bc-eeab-48f2-8668-7416be26873f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 Nov 04 19:21:16 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81410870-bf0c-4110-a112-751062f66283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81410870-bf0c-4110-a112-751062f66283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db35fc-8eb5-4bc9-a636-4bfb8d22e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:16 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume c42807bc-eeab-48f2-8668-7416be26873f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c42807bc-eeab-48f2-8668-7416be26873f', 'volume_size': 1} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.458s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881106366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c560f-a9c0-4862-8580-98b635f51dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:12Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume 988c560f-a9c0-4862-8580-98b635f51dbe {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:16 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:16 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.396s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:16 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe 1073741824 Nov 04 19:21:16 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Deleted volume successfully. Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Attempting download of b695c641-75a9-44db-a0f6-42c125387978 ((None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}])) to volume 650d53aa-f165-4146-9d7b-3f1272480949. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:21:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a842093e-89ed-4a8b-aa11-8b6bde6d3a4a tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-d461e104-43d9-4aa5-a82a-551f8f53e504-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e253e3-bd50-45a5-8dda-e893274b351c]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:17 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9 Nov 04 19:21:17 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:17 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" returned: 0 in 0.590s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:17 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3 Nov 04 19:21:17 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (3f36971e-9403-4214-b818-a047cf6537b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf3f0e2-b32f-4974-9fc3-4851053f3d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf3f0e2-b32f-4974-9fc3-4851053f3d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564521119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a3bb35-9344-4679-bd8f-d87b7c1ada6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:17Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2062d41-f9eb-4426-a54b-a6f42832e388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2062d41-f9eb-4426-a54b-a6f42832e388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cbb2a0-22a2-4e81-872c-b155e0a66b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cbb2a0-22a2-4e81-872c-b155e0a66b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a3bb35-9344-4679-bd8f-d87b7c1ada6c', 'volume_name': 'volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4a5feb-2a44-4786-a6f3-887ec43c9fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4a5feb-2a44-4786-a6f3-887ec43c9fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce8b8c4-00c7-433d-a864-680a58265b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume 18a3bb35-9344-4679-bd8f-d87b7c1ada6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c', 'volume_size': 1} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:17 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe 1073741824" returned: 0 in 0.600s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:17 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe Nov 04 19:21:17 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:17 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9" returned: 0 in 0.580s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:17 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" returned: 0 in 0.397s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3" released by "delete_volume" :: held 1.066s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:17 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9 Nov 04 19:21:17 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (99a8bbe3-4f04-4f62-9451-046186f0de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c5cb32-52c5-42f6-a528-9c4f2a10fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c5cb32-52c5-42f6-a528-9c4f2a10fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779419382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cec0877-814f-4471-966f-edc440ae3d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:18Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e105d906-13f5-430b-8ed7-6aea034c30f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e105d906-13f5-430b-8ed7-6aea034c30f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d7905-3eeb-4614-bc78-bf6ffe5c786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d7905-3eeb-4614-bc78-bf6ffe5c786e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cec0877-814f-4471-966f-edc440ae3d14', 'volume_name': 'volume-3cec0877-814f-4471-966f-edc440ae3d14', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bd5bb0-1d98-446b-aaf1-2f79c3c72e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bd5bb0-1d98-446b-aaf1-2f79c3c72e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbd3e84-5b04-4d20-830c-a86b65c15204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume 3cec0877-814f-4471-966f-edc440ae3d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cec0877-814f-4471-966f-edc440ae3d14', 'volume_size': 1} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Created reservations ['2915895f-b775-4776-9ef8-cd7720bb3866', 'f0c48d85-1d7f-429a-bc97-01bb4761fd2e', 'a6edaad1-c1d1-4792-83c8-e22740d639a2', '71e421f6-af36-461b-a9ac-25558d9facf1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:17 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe" returned: 0 in 0.311s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.930s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747069826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d712de6-c031-40db-9d28-171a0f65ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:13Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume 4d712de6-c031-40db-9d28-171a0f65ac17 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:17 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:17 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 1073741824 Nov 04 19:21:17 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c4d83-aff1-460b-bda4-c00b9e6c345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988c560f-a9c0-4862-8580-98b635f51dbe', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02e86e9-672f-43bf-ad51-6c2d1fc1bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-988c560f-a9c0-4862-8580-98b635f51dbe (988c560f-a9c0-4862-8580-98b635f51dbe): created successfully Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02e86e9-672f-43bf-ad51-6c2d1fc1bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (2df1d2cb-370f-467c-ba17-9ed87a5069aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1e93ff9d-4d44-4717-993b-093ab4b5f68c tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:17 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9" returned: 1 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b695c641-75a9-44db-a0f6-42c125387978_bjarzod9' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdbbc84-eb76-4fc0-bc4d-4dbcdecf65c6]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:18 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:18 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.269s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Deleted volume successfully. Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-880521f3-5c88-4f8e-ae35-d39a76e1876b tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-9f9d0d7e-a5e0-42b9-8182-9b152c11c7d3-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:18 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:18 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 1073741824" returned: 0 in 0.472s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 Nov 04 19:21:18 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD Nov 04 19:21:18 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:18 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] b695c641-75a9-44db-a0f6-42c125387978 was raw, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17" returned: 0 in 0.312s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.488s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747202664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c72c24-cc26-44df-a01f-970db7013983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1355cd5db94a31a487ebc81610797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:13Z,use_quota=True,user_id='484508e53657485aabdff15b83b8e275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Creating volume c3c72c24-cc26-44df-a01f-970db7013983 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:18 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 Nov 04 19:21:18 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:18 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-152e4a7b-78bb-407c-a3dd-82d666817e89-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5e9daf-1751-4ecd-8c9c-f4ebdd278103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d712de6-c031-40db-9d28-171a0f65ac17', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97be9cac-7c7e-4ae1-9427-9e79891e5c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:18 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 1073741824 Nov 04 19:21:18 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-4d712de6-c031-40db-9d28-171a0f65ac17 (4d712de6-c031-40db-9d28-171a0f65ac17): created successfully Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97be9cac-7c7e-4ae1-9427-9e79891e5c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (5a5eb173-3428-4853-bdd6-bfa2ffd1e207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-152e4a7b-78bb-407c-a3dd-82d666817e89-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3c40f0cb-fe9d-4e98-8e11-9e530bd3ff1d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "cinder-quobyte-152e4a7b-78bb-407c-a3dd-82d666817e89" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-152e4a7b-78bb-407c-a3dd-82d666817e89" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e21056-679c-4e33-b8f7-21fdd12fcf7d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:19 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 Nov 04 19:21:19 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:19 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949" returned: 0 in 0.510s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b695c641-75a9-44db-a0f6-42c125387978_gh8axal1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:19 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1G Nov 04 19:21:19 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:19 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 1073741824" returned: 0 in 0.576s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:19 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 Nov 04 19:21:19 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:19 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:19 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89 Nov 04 19:21:19 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:19 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 1G" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Downloaded image b695c641-75a9-44db-a0f6-42c125387978 ((None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}])) to volume 650d53aa-f165-4146-9d7b-3f1272480949 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Temporary image b695c641-75a9-44db-a0f6-42c125387978 for user 727318ece8534b6598cb2afa3c7b093e is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Marking volume 650d53aa-f165-4146-9d7b-3f1272480949 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Copying metadata from image b695c641-75a9-44db-a0f6-42c125387978 to 650d53aa-f165-4146-9d7b-3f1272480949. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Creating volume glance metadata for volume 650d53aa-f165-4146-9d7b-3f1272480949 backed by image b695c641-75a9-44db-a0f6-42c125387978 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b695c641-75a9-44db-a0f6-42c125387978', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bf40a147c6a6629b60af056793795491', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:21:19 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983" returned: 0 in 0.286s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.798s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932217140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a13ee6-d289-4f89-974b-5c14681dba36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:16Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume 89a13ee6-d289-4f89-974b-5c14681dba36 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:19 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 1073741824 Nov 04 19:21:19 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14d3c09-3510-494e-98b9-c0d306f96674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c72c24-cc26-44df-a01f-970db7013983', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95c1664-35d0-482b-90b8-085a78afb651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b996a-8b2a-4541-b740-5ccdbf8e16ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650d53aa-f165-4146-9d7b-3f1272480949', 'volume_size': 1, 'image_id': 'b695c641-75a9-44db-a0f6-42c125387978', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b695c641-75a9-44db-a0f6-42c125387978', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf40a147c6a6629b60af056793795491', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4a111942c4484177aa9f9393266292cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e13ed951db64f401e2a69fbf5e090f62784781186a5694dc4efa2009c12df0bfab8e477149038956219c5c030191f1c7cd03f541f8938d5188ab0ad77ff2fa98', 'id': 'b695c641-75a9-44db-a0f6-42c125387978', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b695c641-75a9-44db-a0f6-42c125387978/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9581db4e-18d6-40ac-b3c9-4397b99bf74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:19 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-152e4a7b-78bb-407c-a3dd-82d666817e89" returned: 0 in 0.333s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Volume volume-c3c72c24-cc26-44df-a01f-970db7013983 (c3c72c24-cc26-44df-a01f-970db7013983): created successfully Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95c1664-35d0-482b-90b8-085a78afb651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Flow 'volume_create_manager' (94889d06-ec4c-42d3-9653-e592bf9f6a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-quobyte-152e4a7b-78bb-407c-a3dd-82d666817e89" released by "delete_volume" :: held 0.863s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Volume volume-650d53aa-f165-4146-9d7b-3f1272480949 (650d53aa-f165-4146-9d7b-3f1272480949): created successfully Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9581db4e-18d6-40ac-b3c9-4397b99bf74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Flow 'volume_create_manager' (c9d9c5c5-f29b-45c2-98c0-f817bb2b28f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1f9e3cc0-27ca-4522-9a3a-c7dfc09c1025 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created volume successfully. Nov 04 19:21:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5cca610c-a3ac-42bb-b19a-b738ed06cfdf tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Created volume successfully. Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Created reservations ['c758c3d3-f3b3-4ada-9746-a5be15215a1c', '0864eb65-1f3c-4d92-8d8b-97503147c06d', 'b2b6af1b-d263-4950-87c7-b804b57d79de', 'c79804b1-ecf5-469b-8386-32b5b3441e7f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:20 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:20 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-c3c72c24-cc26-44df-a01f-970db7013983-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-c3c72c24-cc26-44df-a01f-970db7013983-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-c3c72c24-cc26-44df-a01f-970db7013983" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-c3c72c24-cc26-44df-a01f-970db7013983" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4badf2c6-a2cb-4f31-ab5c-d07318872083]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:20 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:20 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.299s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 1073741824" returned: 0 in 0.615s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Deleted volume successfully. Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-493d25ed-25a4-4fba-9316-0f6dc6f2f449 tempest-CreateVolumesFromImageTest-826904627 None] Lock "cinder-152e4a7b-78bb-407c-a3dd-82d666817e89-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:20 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 Nov 04 19:21:20 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:20 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 Nov 04 19:21:20 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:20 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.213s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664907738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe3acec-37c5-4678-a2be-f101abc068fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:16Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume bbe3acec-37c5-4678-a2be-f101abc068fb {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:20 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:20 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983" returned: 0 in 0.435s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:20 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb 1073741824 Nov 04 19:21:20 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:20 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983 Nov 04 19:21:20 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e094de7-1966-4337-9737-b389abba393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a13ee6-d289-4f89-974b-5c14681dba36', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc61e7cb-8ab5-4e90-aa95-d007d82766a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-89a13ee6-d289-4f89-974b-5c14681dba36 (89a13ee6-d289-4f89-974b-5c14681dba36): created successfully Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc61e7cb-8ab5-4e90-aa95-d007d82766a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (4e36e20b-febc-460e-b829-1e5088c2990a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Acquiring lock "cinder-650d53aa-f165-4146-9d7b-3f1272480949-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-88603e30-3bac-44f9-be0c-ee7e9ab96b32 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "cinder-650d53aa-f165-4146-9d7b-3f1272480949-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Acquiring lock "cinder-quobyte-650d53aa-f165-4146-9d7b-3f1272480949" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:20 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c3c72c24-cc26-44df-a01f-970db7013983" returned: 0 in 0.328s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "cinder-quobyte-650d53aa-f165-4146-9d7b-3f1272480949" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-c3c72c24-cc26-44df-a01f-970db7013983" released by "delete_volume" :: held 0.829s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c6d91-623d-4268-80c3-f1e3b207dc40]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['748a186b-ba20-4946-aa44-93fc3f570434', '594ec9fd-e431-46f9-9251-1ae8e436d9db', 'db323e9d-a891-487c-81ff-39bf14ff6460', '8e94654c-36c1-42d6-bb80-7f94f27806b1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:21 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 Nov 04 19:21:21 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:21 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb 1073741824" returned: 0 in 0.566s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:21 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:21 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb Nov 04 19:21:21 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-4d712de6-c031-40db-9d28-171a0f65ac17-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-4d712de6-c031-40db-9d28-171a0f65ac17-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-4d712de6-c031-40db-9d28-171a0f65ac17" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-4d712de6-c031-40db-9d28-171a0f65ac17" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:21 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949" returned: 0 in 0.507s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df8b0c-9a65-4c53-bfd7-21031216e221]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949 Nov 04 19:21:21 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-609e250c-1bd8-49e1-8f93-b60b2c735a22 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-c3c72c24-cc26-44df-a01f-970db7013983-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:21 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb" returned: 0 in 0.450s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.804s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910685428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c42807bc-eeab-48f2-8668-7416be26873f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:17Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume c42807bc-eeab-48f2-8668-7416be26873f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:21 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:21 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 Nov 04 19:21:21 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bcec617-d1f0-488d-9121-12aa08647c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe3acec-37c5-4678-a2be-f101abc068fb', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69a0df-be48-4c36-9cc9-061a8ee2e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-bbe3acec-37c5-4678-a2be-f101abc068fb (bbe3acec-37c5-4678-a2be-f101abc068fb): created successfully Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69a0df-be48-4c36-9cc9-061a8ee2e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:21 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f 1073741824 Nov 04 19:21:21 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (ee06cbf4-40a5-4b53-bef5-5beb5f1603a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5e556af9-8c5f-4001-9241-51697959e906 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:22 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-650d53aa-f165-4146-9d7b-3f1272480949" returned: 0 in 0.508s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "cinder-quobyte-650d53aa-f165-4146-9d7b-3f1272480949" released by "delete_volume" :: held 1.081s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:22 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17" returned: 0 in 0.594s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Created reservations ['b722f91b-6768-4745-bf7c-5e8d398f4f90', 'f5b256f7-378f-4419-9dad-c5a738d48ed0', '8f8e622c-52eb-4295-aa2c-559211349a2a', 'ac991b84-7f2e-43c3-8960-af4e14010130'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:22 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17 Nov 04 19:21:22 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:22 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:22 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f 1073741824" returned: 0 in 0.714s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-4d712de6-c031-40db-9d28-171a0f65ac17" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-4d712de6-c031-40db-9d28-171a0f65ac17" released by "delete_volume" :: held 1.027s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:22 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f Nov 04 19:21:22 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.344s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['20f5c4d9-70dc-4948-9f06-fdf30d005dcd', '4768d3f0-35a2-490c-8862-c9bd455672d5', '0e9733bd-11e0-404a-b633-d70c7476fd89', '8211ec32-c072-4a7b-9d97-644c012aa28e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:22 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Deleted volume successfully. Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-7c99d8b4-d30b-4995-a4e3-30fe86c277c7 tempest-VolumeAndVolumeTypeFromImageTest-1814712027 None] Lock "cinder-650d53aa-f165-4146-9d7b-3f1272480949-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:22 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:22 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f" returned: 0 in 0.353s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.375s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564521119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a3bb35-9344-4679-bd8f-d87b7c1ada6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:17Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume 18a3bb35-9344-4679-bd8f-d87b7c1ada6c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:22 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91db35fc-8eb5-4bc9-a636-4bfb8d22e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c42807bc-eeab-48f2-8668-7416be26873f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:22 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c 1073741824 Nov 04 19:21:22 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65f2aa-19b6-4870-b55b-0ab0690a3eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:22 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-c42807bc-eeab-48f2-8668-7416be26873f (c42807bc-eeab-48f2-8668-7416be26873f): created successfully Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65f2aa-19b6-4870-b55b-0ab0690a3eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (13a69d94-23ff-4355-9467-2b9f7cbbe246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ceaea9d2-5f38-4fbd-9b69-e9ee5c363b27 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:23 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-b3e5feb2-d39d-412b-a32c-c0033cb50f3d tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-4d712de6-c031-40db-9d28-171a0f65ac17-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:23 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c 1073741824" returned: 0 in 0.600s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:23 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c Nov 04 19:21:23 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-988c560f-a9c0-4862-8580-98b635f51dbe-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-988c560f-a9c0-4862-8580-98b635f51dbe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:23 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" returned: 0 in 0.425s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.088s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-779419382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cec0877-814f-4471-966f-edc440ae3d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f52c46a7107a43bda990b5e4fd2834c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:18Z,use_quota=True,user_id='58234fe2ca4c4249902475e0d2fc76c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Creating volume 3cec0877-814f-4471-966f-edc440ae3d14 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:23 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce8b8c4-00c7-433d-a864-680a58265b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:23 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 1073741824 Nov 04 19:21:23 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2d04f5-fb4b-4625-86ff-16ec209bb07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:24 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-988c560f-a9c0-4862-8580-98b635f51dbe" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c (18a3bb35-9344-4679-bd8f-d87b7c1ada6c): created successfully Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2d04f5-fb4b-4625-86ff-16ec209bb07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (3f36971e-9403-4214-b818-a047cf6537b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-988c560f-a9c0-4862-8580-98b635f51dbe" acquired by "delete_volume" :: waited 0.048s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-81d50876-f7c8-49f8-9daa-af9b6c848513 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[336609ce-5ad5-45ee-ad5c-99ec256ce953]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:24 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe Nov 04 19:21:24 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:24 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 1073741824" returned: 0 in 0.650s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:24 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe" returned: 0 in 0.462s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:24 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe Nov 04 19:21:24 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:24 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 Nov 04 19:21:24 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:24 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-988c560f-a9c0-4862-8580-98b635f51dbe" returned: 0 in 0.351s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-988c560f-a9c0-4862-8580-98b635f51dbe" released by "delete_volume" :: held 0.898s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:25 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14" returned: 0 in 0.342s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbd3e84-5b04-4d20-830c-a86b65c15204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cec0877-814f-4471-966f-edc440ae3d14', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780e0cb9-a5c7-4b19-b094-579b3c83aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Volume volume-3cec0877-814f-4471-966f-edc440ae3d14 (3cec0877-814f-4471-966f-edc440ae3d14): created successfully Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780e0cb9-a5c7-4b19-b094-579b3c83aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Flow 'volume_create_manager' (99a8bbe3-4f04-4f62-9451-046186f0de7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1763cf65-36e5-4fcc-8dc3-0f5bd267500d tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created volume successfully. Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['aed91cfe-547b-44f0-80c4-b0d0c167a2ed', '9d7839ea-0405-4b0a-9eb3-8c753f090299', '25729705-fd7d-4208-a187-6ef3f0b1c97f', '174419cc-5f40-4223-adf2-5e3a90c1a58e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:25 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:25 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Flow 'volume_create_manager' (a3a7f31f-8a76-4517-b99b-0289738fcf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b32c63b-4050-46b8-8c43-3bdcdbc0cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b32c63b-4050-46b8-8c43-3bdcdbc0cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1162206185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c09abb-8afb-4432-92a5-8d09a602856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599ea3ea15f546b79dcc0a7de2bc770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:25Z,use_quota=True,user_id='89bb39e88b1d4592a2c46ea87443df61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e84d258-4906-40f8-bd10-fbe09c1b7638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e84d258-4906-40f8-bd10-fbe09c1b7638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8204d37b-13ca-4247-a11e-c388d95ecf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8204d37b-13ca-4247-a11e-c388d95ecf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c09abb-8afb-4432-92a5-8d09a602856c', 'volume_name': 'volume-d8c09abb-8afb-4432-92a5-8d09a602856c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b623a5d-1bc5-49a7-a864-ae624780ad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b623a5d-1bc5-49a7-a864-ae624780ad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fecb336-60c5-42cf-9009-0ede020d1e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Volume d8c09abb-8afb-4432-92a5-8d09a602856c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c09abb-8afb-4432-92a5-8d09a602856c', 'volume_size': 1} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1162206185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c09abb-8afb-4432-92a5-8d09a602856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599ea3ea15f546b79dcc0a7de2bc770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:25Z,use_quota=True,user_id='89bb39e88b1d4592a2c46ea87443df61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Creating volume d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:25 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:25 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.323s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:25 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:25 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c 1073741824 Nov 04 19:21:25 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5a05512a-bbdf-4e95-b27c-8cc475008bc6 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-988c560f-a9c0-4862-8580-98b635f51dbe-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-3cec0877-814f-4471-966f-edc440ae3d14-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-3cec0877-814f-4471-966f-edc440ae3d14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-3cec0877-814f-4471-966f-edc440ae3d14" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-3cec0877-814f-4471-966f-edc440ae3d14" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93edf22-01cf-45c6-a3f9-b9bd6a0cddea]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:25 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 Nov 04 19:21:25 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c 1073741824" returned: 0 in 0.564s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:26 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:26 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-b4745789-aa88-4d0a-a44f-1e4345047418-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-b4745789-aa88-4d0a-a44f-1e4345047418-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:26 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14" returned: 0 in 0.499s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:26 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14 Nov 04 19:21:26 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-b4745789-aa88-4d0a-a44f-1e4345047418" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-b4745789-aa88-4d0a-a44f-1e4345047418" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:26 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.320s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[05576749-fe1b-4c75-972a-cbfbf65dc05b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fecb336-60c5-42cf-9009-0ede020d1e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c09abb-8afb-4432-92a5-8d09a602856c', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5e0e94-8f6b-407b-aeea-34d90cc55826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Volume volume-d8c09abb-8afb-4432-92a5-8d09a602856c (d8c09abb-8afb-4432-92a5-8d09a602856c): created successfully Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5e0e94-8f6b-407b-aeea-34d90cc55826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Flow 'volume_create_manager' (a3a7f31f-8a76-4517-b99b-0289738fcf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6edbd33d-45f1-4447-9810-029730deb755 tempest-VolumeDependencyTests-1104669762 None] Created volume successfully. Nov 04 19:21:26 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 Nov 04 19:21:26 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-3cec0877-814f-4471-966f-edc440ae3d14" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-3cec0877-814f-4471-966f-edc440ae3d14" released by "delete_volume" :: held 0.869s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['cb6003ff-ee05-4c58-865f-6c5accdcad33', '5a6b29b3-caca-4907-9d4c-58cd0fdd5c05', '9c01c91f-fa9d-4d21-8a6c-addc733eb551', '90f7c8ed-b8e6-4a17-bcb8-c10cb5c0364e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:26 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:26 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-18a3bb35-9344-4679-bd8f-d87b7c1ada6c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:26 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418 Nov 04 19:21:26 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-18a3bb35-9344-4679-bd8f-d87b7c1ada6c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[036873d6-63de-439f-bab8-4dd16f7a4a12]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:27 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.312s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ec4f4079-2127-4af1-b0f4-89b61b034186 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-3cec0877-814f-4471-966f-edc440ae3d14-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:27 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c Nov 04 19:21:27 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:27 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-b4745789-aa88-4d0a-a44f-1e4345047418" returned: 0 in 0.369s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-b4745789-aa88-4d0a-a44f-1e4345047418" released by "delete_volume" :: held 0.896s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['56f48f82-dfdb-435d-9b6b-4187586e3033', '756d418e-8f35-4532-a5d4-9c375839f50b', '1dbaaefa-cabd-4e2b-96ea-6f27cb15db4f', '58c72d36-1abc-48f3-b118-20b7f9b07a1e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:27 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:27 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:27 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" returned: 0 in 0.486s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:27 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c Nov 04 19:21:27 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:27 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.302s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:27 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeac96ab-273c-49d0-90f1-6ba5ef476d6e tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-b4745789-aa88-4d0a-a44f-1e4345047418-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Creating offline snapshot 94bafb5c-97cd-4481-948b-d80f79692143 of volume d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de7e57-6b1b-4879-8339-8db659755f1b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:27 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-18a3bb35-9344-4679-bd8f-d87b7c1ada6c" released by "delete_volume" :: held 0.891s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:28 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:28 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['18edf226-1749-4a32-ab31-1eaba932dca3', '69c44a85-4a2d-4528-a99c-2b5f0d6a6b33', '20abf4f7-64c6-4c32-9ce0-7b293a73b0ae', 'dc046adb-8bbb-48b4-982a-204da4052fe9'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:28 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:28 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-c42807bc-eeab-48f2-8668-7416be26873f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-c42807bc-eeab-48f2-8668-7416be26873f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-c42807bc-eeab-48f2-8668-7416be26873f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-c42807bc-eeab-48f2-8668-7416be26873f" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:28 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[394eaffe-dd98-4190-bc83-c6275b683d1e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:28 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 1G Nov 04 19:21:28 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.385s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:28 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f Nov 04 19:21:28 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e19b400c-88b4-406e-9885-a25e3d564090 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-18a3bb35-9344-4679-bd8f-d87b7c1ada6c-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-97d00082-f8b0-44f7-ab65-267354456fc7-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-97d00082-f8b0-44f7-ab65-267354456fc7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-97d00082-f8b0-44f7-ab65-267354456fc7" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-97d00082-f8b0-44f7-ab65-267354456fc7" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e037d-a500-4f62-a36d-ae3258ab23e6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:28 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 1G" returned: 0 in 0.607s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c09abb-8afb-4432-92a5-8d09a602856c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:28 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 Nov 04 19:21:28 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:28 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c09abb-8afb-4432-92a5-8d09a602856c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f" returned: 0 in 0.621s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:28 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f Nov 04 19:21:29 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7" returned: 0 in 0.465s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-c42807bc-eeab-48f2-8668-7416be26873f" returned: 0 in 0.305s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7 Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c09abb-8afb-4432-92a5-8d09a602856c -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.362s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 is being set with open permissions: ugo+rw Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-c42807bc-eeab-48f2-8668-7416be26873f" released by "delete_volume" :: held 1.011s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:29 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:29 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['0d62f1ea-294a-4061-b411-8e7247d9197a', '86c3b870-e0e2-4115-9883-514bab1e2e82', 'ad2c94ee-55b3-4112-8b4f-9904ce61705c', '06840b97-4be4-4aba-b0da-170bc7f8ea0a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-97d00082-f8b0-44f7-ab65-267354456fc7" returned: 0 in 0.326s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:29 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-97d00082-f8b0-44f7-ab65-267354456fc7" released by "delete_volume" :: held 0.851s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:29 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.339s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['f360877f-3e8a-45a2-9b54-3e3fa5ceca88', '43b5a5e8-9230-4670-945f-b6ac89965f0c', 'a359d623-cad3-4c57-b1ca-945c378fc6d1', '08653aa6-ed62-4beb-9a75-03f874072da8'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:29 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info Nov 04 19:21:29 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:29 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:29 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:29 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-28e70e7d-bfa6-43a6-9f22-84166f8bbda4-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:29 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-28e70e7d-bfa6-43a6-9f22-84166f8bbda4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2583a39a-59c7-4ff7-968e-6fd197314ddc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-c42807bc-eeab-48f2-8668-7416be26873f-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "cinder-quobyte-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:30 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:30 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info is being set with open permissions: ugo+rw Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae01f9-b3b4-49d5-90db-7f595d7b8533]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:30 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info Nov 04 19:21:30 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:30 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.348s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8e2a1777-0a78-4d80-85fb-4030906dbd47 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-97d00082-f8b0-44f7-ab65-267354456fc7-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:30 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 Nov 04 19:21:30 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:30 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.info" returned: 0 in 0.280s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:30 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b8632457-7be5-447f-a478-d1e167ca6f88 tempest-VolumeDependencyTests-1104669762 None] Create snapshot completed successfully Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-bbe3acec-37c5-4678-a2be-f101abc068fb-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-bbe3acec-37c5-4678-a2be-f101abc068fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-bbe3acec-37c5-4678-a2be-f101abc068fb" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-bbe3acec-37c5-4678-a2be-f101abc068fb" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5cd525-7710-4e3a-a451-94f123c01f05]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:30 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" returned: 0 in 0.503s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:30 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4 Nov 04 19:21:30 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:30 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb Nov 04 19:21:30 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:30 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" returned: 0 in 0.260s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-quobyte-28e70e7d-bfa6-43a6-9f22-84166f8bbda4" released by "delete_volume" :: held 0.839s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:30 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Created reservations ['8708c0a2-843d-4b09-aa7b-e1fbe5f8ac0d', '803c3100-d8ad-4845-a1dd-5cc622db58ca', '55ba8e6f-6e80-4538-ad64-a6e4ea32d63f', 'd95bbda2-5df9-44ef-8959-d9f7a445d938'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:31 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb" returned: 0 in 0.455s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:31 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb Nov 04 19:21:31 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:31 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:31 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:31 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-bbe3acec-37c5-4678-a2be-f101abc068fb" returned: 0 in 0.357s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:31 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-bbe3acec-37c5-4678-a2be-f101abc068fb" released by "delete_volume" :: held 0.883s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:31 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Deleted volume successfully. Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-990908f7-014a-4348-8a35-db6363389c52 tempest-CreateVolumesFromSourceVolumeTest-40299359 None] Lock "cinder-28e70e7d-bfa6-43a6-9f22-84166f8bbda4-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['8e9de487-03e8-43a3-8c08-30c51f330b3f', 'c6eb1e28-89e9-4358-a077-24df70779d7d', 'd5bfe29e-610c-4708-a909-3cd820309a2e', 'a7f0d94c-bab6-4a57-806a-9849972a4633'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:31 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:31 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-89a13ee6-d289-4f89-974b-5c14681dba36-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Flow 'volume_create_manager' (034a8391-471c-4ef1-adc7-13123b07e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f34bca-5b3a-4cfb-aa3a-6d054467ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-89a13ee6-d289-4f89-974b-5c14681dba36-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f34bca-5b3a-4cfb-aa3a-6d054467ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-463571729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f83fa5-58fc-434f-91ad-92ea6401ae09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599ea3ea15f546b79dcc0a7de2bc770b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=94bafb5c-97cd-4481-948b-d80f79692143,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:32Z,use_quota=True,user_id='89bb39e88b1d4592a2c46ea87443df61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798e779-8248-40c2-8f26-017936aaa78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798e779-8248-40c2-8f26-017936aaa78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f62f7c-7ed1-4be1-865c-117e2bbd0024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f62f7c-7ed1-4be1-865c-117e2bbd0024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12f83fa5-58fc-434f-91ad-92ea6401ae09', 'volume_name': 'volume-12f83fa5-58fc-434f-91ad-92ea6401ae09', 'volume_size': 1, 'snapshot_id': '94bafb5c-97cd-4481-948b-d80f79692143'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6465e-b2f9-4bd4-a40e-dd3b4cbc6239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6465e-b2f9-4bd4-a40e-dd3b4cbc6239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85448f21-38e9-4329-bbee-f3662ddad218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:31 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Volume 12f83fa5-58fc-434f-91ad-92ea6401ae09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12f83fa5-58fc-434f-91ad-92ea6401ae09', 'volume_size': 1, 'snapshot_id': '94bafb5c-97cd-4481-948b-d80f79692143'} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143-12f83fa5-58fc-434f-91ad-92ea6401ae09" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-89a13ee6-d289-4f89-974b-5c14681dba36" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143-12f83fa5-58fc-434f-91ad-92ea6401ae09" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Creating volume 12f83fa5-58fc-434f-91ad-92ea6401ae09 from snapshot 94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-89a13ee6-d289-4f89-974b-5c14681dba36" acquired by "delete_volume" :: waited 0.041s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] snapshot: 94bafb5c-97cd-4481-948b-d80f79692143, volume: 12f83fa5-58fc-434f-91ad-92ea6401ae09, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:21:32 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8311c3eb-c81f-4da5-98b5-8373f47166ff]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe82c4f-6a8c-49ca-88a9-2383d76a4132]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-dbfe6b36-1425-4181-9aba-ab7cda576435 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-bbe3acec-37c5-4678-a2be-f101abc068fb-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:32 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 Nov 04 19:21:32 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:32 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:32 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Flow 'volume_create_manager' (03282533-fcae-409a-baa6-6c60c4aae2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045178ff-068a-4b2f-ab12-77d420eedd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045178ff-068a-4b2f-ab12-77d420eedd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16adcc62-a28a-4a30-aa06-72363353e3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3415244bce41f5a655ba4c13aff114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:32Z,use_quota=True,user_id='369aa6446a164f6d85bb44485f8f044d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cf1914-9718-499e-8bd9-3ca4219a5684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cf1914-9718-499e-8bd9-3ca4219a5684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fdf163-48b5-4361-8315-457017cad220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.image.glance [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Creating Keystone auth plugin from conf {{(pid=87367) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:21:32 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36" returned: 0 in 0.479s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:32 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36 Nov 04 19:21:32 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:32 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.554s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8c09abb-8afb-4432-92a5-8d09a602856c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1675f-3bfa-4f77-97bb-a81d4449302b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:32 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-89a13ee6-d289-4f89-974b-5c14681dba36" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-89a13ee6-d289-4f89-974b-5c14681dba36" released by "delete_volume" :: held 0.872s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:32 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:32 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['77b076d0-23e0-45ee-ae15-3e8db417b07a', 'ac56148d-3cd0-47e9-a5ca-f57618623657', '82894f4f-9298-4061-a060-cdbf811a3859', '76235ae2-08e2-4dac-b1d7-3fb886c4db14'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fdf163-48b5-4361-8315-457017cad220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16adcc62-a28a-4a30-aa06-72363353e3c5', 'volume_name': 'volume-16adcc62-a28a-4a30-aa06-72363353e3c5', 'volume_size': 1, 'image_id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1af09cf0882800553ee25999427e8780', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac3415244bce41f5a655ba4c13aff114', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '304bb622845e2b867048a9ab2687f8040f4a29a0855271b19c225e80b0111db6ebedda55f7e978b64ea2bb11f4b198325fc4211511c01e1ebaefff83ce8b6543', 'id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69dd5b64-c66f-42c6-9689-2822c83c78bf/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb121f-8e25-4af2-b52e-107aa05741b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eb121f-8e25-4af2-b52e-107aa05741b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d28f9b2-60e5-4e67-a8a2-2401583054de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:33 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Volume 16adcc62-a28a-4a30-aa06-72363353e3c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16adcc62-a28a-4a30-aa06-72363353e3c5', 'volume_size': 1, 'image_id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1af09cf0882800553ee25999427e8780', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac3415244bce41f5a655ba4c13aff114', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '304bb622845e2b867048a9ab2687f8040f4a29a0855271b19c225e80b0111db6ebedda55f7e978b64ea2bb11f4b198325fc4211511c01e1ebaefff83ce8b6543', 'id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69dd5b64-c66f-42c6-9689-2822c83c78bf/file', 'properties': {}}, 'image_service': } Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Trying to clone 16adcc62-a28a-4a30-aa06-72363353e3c5 from image 69dd5b64-c66f-42c6-9689-2822c83c78bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}]). {{(pid=87367) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:33 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:33 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:21:33 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[627f7796-3209-468e-9ac4-6c40882db8fa]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:33 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.499s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:33 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 Nov 04 19:21:33 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:33 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:33 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:33 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.385s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:33 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4021da16-d37b-49bc-aebf-b182073753dc tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-89a13ee6-d289-4f89-974b-5c14681dba36-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:33 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:33 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:33 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:34 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Temporary image 69dd5b64-c66f-42c6-9689-2822c83c78bf is fetched for user 369aa6446a164f6d85bb44485f8f044d. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-fbb15a3a-9828-4b99-860e-645d0dd9ba56-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-fbb15a3a-9828-4b99-860e-645d0dd9ba56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed29b68-c897-4dce-bb71-0e57116091d9]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-fbb15a3a-9828-4b99-860e-645d0dd9ba56" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-fbb15a3a-9828-4b99-860e-645d0dd9ba56" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleting offline snapshot fbb15a3a-9828-4b99-860e-645d0dd9ba56 of volume 698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] snapshot_file for this snap is: volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f3b831-05d4-47c7-be79-dcdd44dcfa11]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:34 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:34 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:34 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 Nov 04 19:21:34 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:35 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:35 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:35 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:35 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56" returned: 0 in 1.116s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698cb782-08ce-45f7-ab38-55ea1e49b97d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:21:35 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 1 in 0.687s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ec2a9-bfa6-4e3b-ba70-d6b75053b0f1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:36 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d Nov 04 19:21:36 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:36 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d" returned: 0 in 1.073s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:36 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 Nov 04 19:21:36 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:37 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56" returned: 0 in 0.692s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:37 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56 Nov 04 19:21:37 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (b4bde39a-27ac-4e3f-a059-265fbdeddabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564ceed2-280d-4589-aad9-a3197e4f163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564ceed2-280d-4589-aad9-a3197e4f163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154410621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60ccea-ed7f-4862-a089-40a7b92bf750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:38Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4889c30-4e21-4bde-a4c4-23ed4b13711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4889c30-4e21-4bde-a4c4-23ed4b13711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ad2e89-b2b7-4d5c-87bf-060da557fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ad2e89-b2b7-4d5c-87bf-060da557fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a60ccea-ed7f-4862-a089-40a7b92bf750', 'volume_name': 'volume-9a60ccea-ed7f-4862-a089-40a7b92bf750', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748ffc88-800e-488d-9dcc-c47d1fab4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748ffc88-800e-488d-9dcc-c47d1fab4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9582b8-8c27-421e-ae72-a48f66e43394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:37 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Volume 9a60ccea-ed7f-4862-a089-40a7b92bf750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a60ccea-ed7f-4862-a089-40a7b92bf750', 'volume_size': 1} Nov 04 19:21:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:38 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d.fbb15a3a-9828-4b99-860e-645d0dd9ba56" returned: 0 in 0.428s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-fbb15a3a-9828-4b99-860e-645d0dd9ba56" released by "_delete_snapshot" :: held 3.661s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" released by "delete_snapshot" :: held 3.749s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['72e25851-6ef1-423d-af54-12c45cbddaf0', '42a87623-2b0b-4927-927d-ee44be522f61', 'f266d96b-388a-4d50-9013-54cf65f8ff82', 'baa849e3-7387-4d84-aab4-1a20c24cd2f4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:38 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Delete snapshot completed successfully. Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8877d332-5dcb-4a8e-9cf0-09e82ad68fe4 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-fbb15a3a-9828-4b99-860e-645d0dd9ba56-delete_snapshot" released by "delete_snapshot" :: held 4.068s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-698cb782-08ce-45f7-ab38-55ea1e49b97d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-698cb782-08ce-45f7-ab38-55ea1e49b97d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" acquired by "delete_volume" :: waited 0.022s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d148c4-3663-4475-8d50-58f7f89bd24a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:39 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d Nov 04 19:21:39 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:39 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d" returned: 0 in 0.541s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:39 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d Nov 04 19:21:39 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:39 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-698cb782-08ce-45f7-ab38-55ea1e49b97d" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-quobyte-698cb782-08ce-45f7-ab38-55ea1e49b97d" released by "delete_volume" :: held 1.045s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Created reservations ['76223217-6bfc-465d-b609-63b0e4475e54', 'e39e27df-492a-4d8c-aa14-8f7a53212301', '01aa1d8d-3beb-4356-97a4-5da4e8fb9465', '0b860163-82c2-46ea-86e1-578f827146f9'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:40 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:40 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:40 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.546s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:40 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Deleted volume successfully. Nov 04 19:21:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-83e81564-329e-427c-8d11-4d608da3e296 tempest-CreateVolumesFromSnapshotTest-2112838884 None] Lock "cinder-698cb782-08ce-45f7-ab38-55ea1e49b97d-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:41 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09" returned: 0 in 7.924s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:21:41 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Converted 1024.00 MB image at 129.21 MB/s Nov 04 19:21:41 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 is being set with open permissions: ugo+rw Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:41 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 Nov 04 19:21:41 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:41 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09" returned: 0 in 0.266s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" released by "_copy_volume_from_snapshot" :: held 9.416s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143-12f83fa5-58fc-434f-91ad-92ea6401ae09" released by "_create_volume_from_snapshot" :: held 9.507s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.531s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.730s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16adcc62-a28a-4a30-aa06-72363353e3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3415244bce41f5a655ba4c13aff114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:32Z,use_quota=True,user_id='369aa6446a164f6d85bb44485f8f044d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Creating volume 16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:41 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:41 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1073741824 Nov 04 19:21:41 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85448f21-38e9-4329-bbee-f3662ddad218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f83fa5-58fc-434f-91ad-92ea6401ae09', 'volume_size': 1, 'snapshot_id': '94bafb5c-97cd-4481-948b-d80f79692143'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce7467d-720f-41d5-b773-0d2a89d84b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:41 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Volume volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 (12f83fa5-58fc-434f-91ad-92ea6401ae09): created successfully Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce7467d-720f-41d5-b773-0d2a89d84b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Flow 'volume_create_manager' (034a8391-471c-4ef1-adc7-13123b07e446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-140c5d86-a130-4a56-9ee1-833e84fc1038 tempest-VolumeDependencyTests-1104669762 None] Created volume successfully. Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-94bafb5c-97cd-4481-948b-d80f79692143-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-94bafb5c-97cd-4481-948b-d80f79692143-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Deleting offline snapshot 94bafb5c-97cd-4481-948b-d80f79692143 of volume d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] snapshot_file for this snap is: volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d0e76e-b7ce-49f9-8380-3c488f910c76]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:42 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:42 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:42 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1073741824" returned: 0 in 0.559s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:42 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 Nov 04 19:21:42 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:42 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.428s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8c09abb-8afb-4432-92a5-8d09a602856c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a2b16f-84d8-4222-9e29-861bee3e10aa]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:42 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5" returned: 0 in 0.311s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.622s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154410621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a60ccea-ed7f-4862-a089-40a7b92bf750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:38Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Creating volume 9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:42 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:42 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 1073741824 Nov 04 19:21:42 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Attempting download of 69dd5b64-c66f-42c6-9689-2822c83c78bf ((None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}])) to volume 16adcc62-a28a-4a30-aa06-72363353e3c5. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:21:42 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:42 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e818ce03-6648-41cc-8663-e8f1d6a0dfad]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:42 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u Nov 04 19:21:42 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 1073741824" returned: 0 in 0.535s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u" returned: 0 in 0.429s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 Nov 04 19:21:43 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.706s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:43 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u Nov 04 19:21:43 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750" returned: 0 in 0.307s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9582b8-8c27-421e-ae72-a48f66e43394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a60ccea-ed7f-4862-a089-40a7b92bf750', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b4d4a-ab07-434c-bd0f-3ac4eff330db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:43 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Volume volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 (9a60ccea-ed7f-4862-a089-40a7b92bf750): created successfully Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b4d4a-ab07-434c-bd0f-3ac4eff330db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (b4bde39a-27ac-4e3f-a059-265fbdeddabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-32ee0bdf-6121-40e4-9ef0-7a1f3dffab02 tempest-ProjectReaderTests-80632435 None] Created volume successfully. Nov 04 19:21:43 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u" returned: 1 in 0.452s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69dd5b64-c66f-42c6-9689-2822c83c78bf_rg0q1b3u' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc885d2-b48f-48b2-a414-75845dda13e3]: (4, 'raw') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.435s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143 Nov 04 19:21:43 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:43 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:43 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:43 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c.94bafb5c-97cd-4481-948b-d80f79692143" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-94bafb5c-97cd-4481-948b-d80f79692143" released by "_delete_snapshot" :: held 2.036s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" released by "delete_snapshot" :: held 2.075s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:44 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD Nov 04 19:21:44 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Created reservations ['d18d657e-7c24-4e4a-9d92-21d19ef7dfa0', '232b1620-671c-4218-9cc7-aebad1cced5e', '40ffd059-6072-4c21-b07e-3367a4b24718', 'eb883237-afa0-49b0-96cd-4621ae4901bc'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Delete snapshot completed successfully. Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0da3b3db-296d-4dd9-ae2d-67760bbf11a9 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-94bafb5c-97cd-4481-948b-d80f79692143-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:44 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] 69dd5b64-c66f-42c6-9689-2822c83c78bf was raw, converting to qcow2 {{(pid=87367) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:44 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 Nov 04 19:21:44 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Creating offline snapshot fd710e37-f281-433a-af84-ef349ef77f45 of volume 9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e77f15-58f4-4e56-943a-06518ab2dd5e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:44 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 Nov 04 19:21:44 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:44 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5" returned: 0 in 0.584s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69dd5b64-c66f-42c6-9689-2822c83c78bf_125jxclfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:21:44 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:44 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1G Nov 04 19:21:44 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:44 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750" returned: 0 in 0.448s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:44 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 1G Nov 04 19:21:44 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-d8c09abb-8afb-4432-92a5-8d09a602856c-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-d8c09abb-8afb-4432-92a5-8d09a602856c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36df64-0920-47e6-b39c-980667b4f97a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:45 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 1G" returned: 0 in 0.434s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Downloaded image 69dd5b64-c66f-42c6-9689-2822c83c78bf ((None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}])) to volume 16adcc62-a28a-4a30-aa06-72363353e3c5 successfully. {{(pid=87367) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Temporary image 69dd5b64-c66f-42c6-9689-2822c83c78bf for user 369aa6446a164f6d85bb44485f8f044d is deleted. {{(pid=87367) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.volume_utils [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Marking volume 16adcc62-a28a-4a30-aa06-72363353e3c5 as bootable. {{(pid=87367) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Copying metadata from image 69dd5b64-c66f-42c6-9689-2822c83c78bf to 16adcc62-a28a-4a30-aa06-72363353e3c5. {{(pid=87367) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Creating volume glance metadata for volume 16adcc62-a28a-4a30-aa06-72363353e3c5 backed by image 69dd5b64-c66f-42c6-9689-2822c83c78bf with: {'image_id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1af09cf0882800553ee25999427e8780', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87367) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:21:45 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:45 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d28f9b2-60e5-4e67-a8a2-2401583054de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16adcc62-a28a-4a30-aa06-72363353e3c5', 'volume_size': 1, 'image_id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69dd5b64-c66f-42c6-9689-2822c83c78bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1af09cf0882800553ee25999427e8780', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ac3415244bce41f5a655ba4c13aff114', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '304bb622845e2b867048a9ab2687f8040f4a29a0855271b19c225e80b0111db6ebedda55f7e978b64ea2bb11f4b198325fc4211511c01e1ebaefff83ce8b6543', 'id': '69dd5b64-c66f-42c6-9689-2822c83c78bf', 'created_at': datetime.datetime(2026, 11, 4, 18, 21, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 21, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69dd5b64-c66f-42c6-9689-2822c83c78bf/file', 'properties': {}}, 'image_service': }' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c627de7b-6be7-4375-866c-dc01a3c1e5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:45 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Volume volume-16adcc62-a28a-4a30-aa06-72363353e3c5 (16adcc62-a28a-4a30-aa06-72363353e3c5): created successfully Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c627de7b-6be7-4375-866c-dc01a3c1e5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Flow 'volume_create_manager' (03282533-fcae-409a-baa6-6c60c4aae2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:45 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6ea0b263-d4db-4cc0-b4b4-159be0dbfdfa tempest-VolumeImageDependencyTests-1945960725 None] Created volume successfully. Nov 04 19:21:45 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 1G" returned: 0 in 0.598s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:45 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 Nov 04 19:21:45 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Acquiring lock "cinder-16adcc62-a28a-4a30-aa06-72363353e3c5-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:45 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.470s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "cinder-16adcc62-a28a-4a30-aa06-72363353e3c5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:45 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c Nov 04 19:21:45 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Acquiring lock "cinder-quobyte-16adcc62-a28a-4a30-aa06-72363353e3c5" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "cinder-quobyte-16adcc62-a28a-4a30-aa06-72363353e3c5" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76e0ac-60e8-4666-a683-aa97564295cc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:45 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45" returned: 0 in 0.408s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:45 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 is being set with open permissions: ugo+rw Nov 04 19:21:45 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 Nov 04 19:21:46 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 Nov 04 19:21:46 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-d8c09abb-8afb-4432-92a5-8d09a602856c" returned: 0 in 0.343s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-d8c09abb-8afb-4432-92a5-8d09a602856c" released by "delete_volume" :: held 0.911s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Created reservations ['99fdf215-b8ce-4eb0-98de-e414a324837f', '79ed5491-099c-45c7-9334-374dd779a1f1', '678c6975-48b6-4872-a4fb-d032311e42f6', '0faf67cf-ed57-4090-9a55-147a053fa062'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:46 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-12f83fa5-58fc-434f-91ad-92ea6401ae09-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:46 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5" returned: 0 in 0.498s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-12f83fa5-58fc-434f-91ad-92ea6401ae09-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45" returned: 0 in 0.445s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5 Nov 04 19:21:46 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info Nov 04 19:21:46 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cc6b84-e8b9-4abb-ba79-e8ef9fa3741e]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.367s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:46 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Deleted volume successfully. Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e30dceeb-b896-4a80-ba84-e602466fc905 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-d8c09abb-8afb-4432-92a5-8d09a602856c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:46 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 Nov 04 19:21:46 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info" returned: 0 in 0.346s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info is being set with open permissions: ugo+rw Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:46 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:46 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-16adcc62-a28a-4a30-aa06-72363353e3c5" returned: 0 in 0.451s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:46 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "cinder-quobyte-16adcc62-a28a-4a30-aa06-72363353e3c5" released by "delete_volume" :: held 1.024s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:46 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Created reservations ['9783d969-89e2-4e17-ab64-b97e05e4143a', '19629050-8821-4e9f-ba1e-ae909ce952d2', 'cd0cf5b3-8653-4378-8f30-a6a09c5b19dc', '86076ad8-bd26-4fb9-a8c3-abf24b43fbf5'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:47 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:47 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:47 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09" returned: 0 in 0.504s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:47 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09 Nov 04 19:21:47 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:47 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.info" returned: 0 in 0.333s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6e7c1b27-e90c-43d8-81ea-477a9f067c56 tempest-ProjectReaderTests-80632435 None] Create snapshot completed successfully Nov 04 19:21:47 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.298s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Deleted volume successfully. Nov 04 19:21:47 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-12f83fa5-58fc-434f-91ad-92ea6401ae09" returned: 0 in 0.262s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-quobyte-12f83fa5-58fc-434f-91ad-92ea6401ae09" released by "delete_volume" :: held 0.837s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c193f513-ffc9-4ca0-ae18-cddbb33e068a tempest-VolumeImageDependencyTests-1945960725 None] Lock "cinder-16adcc62-a28a-4a30-aa06-72363353e3c5-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Created reservations ['b793062f-5135-4573-a794-8c893731c34a', '410ff2a3-8149-4d48-80eb-c240c246534d', 'de04cccc-1f4a-40bc-869b-603241e95b0d', '6552c8bf-6a71-4a1c-98d8-0980a80afd5e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:47 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:47 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:47 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.278s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:47 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Deleted volume successfully. Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ecefa15-616c-4645-a23e-72e6320f12e5 tempest-VolumeDependencyTests-1104669762 None] Lock "cinder-12f83fa5-58fc-434f-91ad-92ea6401ae09-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-fd710e37-f281-433a-af84-ef349ef77f45-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-fd710e37-f281-433a-af84-ef349ef77f45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-fd710e37-f281-433a-af84-ef349ef77f45" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-fd710e37-f281-433a-af84-ef349ef77f45" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Deleting offline snapshot fd710e37-f281-433a-af84-ef349ef77f45 of volume 9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] snapshot_file for this snap is: volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af55616-a8cd-4109-88ee-fa3893145aca]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:48 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 Nov 04 19:21:48 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:48 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45" returned: 0 in 0.465s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a60ccea-ed7f-4862-a089-40a7b92bf750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6613005c-c09e-4dcb-b2a3-cb173b805e6b]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:48 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 Nov 04 19:21:48 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:48 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750" returned: 0 in 0.425s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:48 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 Nov 04 19:21:48 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:49 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45" returned: 0 in 0.454s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:49 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45 Nov 04 19:21:49 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:49 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750.fd710e37-f281-433a-af84-ef349ef77f45" returned: 0 in 0.319s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-fd710e37-f281-433a-af84-ef349ef77f45" released by "_delete_snapshot" :: held 1.830s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" released by "delete_snapshot" :: held 1.860s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:49 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Created reservations ['194a409a-eaa5-4787-ab18-2c4d42bb59b4', 'c6c5e54a-4ff8-4f67-bada-c93bc97643be', 'c3a6bc18-2c63-4eb8-8bc6-da44a80d8184', '37d38dae-cfaf-42e4-a4f3-4ddf6dc36acd'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Delete snapshot completed successfully. Nov 04 19:21:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-5fce5265-7fdd-4f38-84b7-840ce9021d1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-fd710e37-f281-433a-af84-ef349ef77f45-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-9a60ccea-ed7f-4862-a089-40a7b92bf750-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "cinder-9a60ccea-ed7f-4862-a089-40a7b92bf750-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[11379432-7a38-4709-a7d6-422c4ca18234]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:51 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 Nov 04 19:21:51 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:51 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750" returned: 0 in 0.503s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:51 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750 Nov 04 19:21:51 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:52 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-9a60ccea-ed7f-4862-a089-40a7b92bf750" returned: 0 in 0.323s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-9a60ccea-ed7f-4862-a089-40a7b92bf750" released by "delete_volume" :: held 0.915s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (df906d5c-96f9-41ef-8ebd-ea9c100b5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00e61e9-73d7-47d3-bcf7-ac8a62d0b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00e61e9-73d7-47d3-bcf7-ac8a62d0b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173715532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0572975c-ac04-4fcc-b95a-1c9e5437976f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:52Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231766cc-0474-459a-9b4a-eeab6530a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231766cc-0474-459a-9b4a-eeab6530a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0de5f-96ba-49db-b7d9-2c5ef0ec82d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d0de5f-96ba-49db-b7d9-2c5ef0ec82d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0572975c-ac04-4fcc-b95a-1c9e5437976f', 'volume_name': 'volume-0572975c-ac04-4fcc-b95a-1c9e5437976f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26592312-ec40-4abd-addf-7794926b512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26592312-ec40-4abd-addf-7794926b512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e73076-5b36-4d4c-a5a1-998d1004c370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Volume 0572975c-ac04-4fcc-b95a-1c9e5437976f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0572975c-ac04-4fcc-b95a-1c9e5437976f', 'volume_size': 1} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173715532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0572975c-ac04-4fcc-b95a-1c9e5437976f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:52Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Creating volume 0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:52 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:52 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f 1073741824 Nov 04 19:21:52 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Created reservations ['c81b4adb-3509-4449-86ea-b9cf1dd8349d', '1fc907bc-2d80-44a3-80d1-16f9589d0c9b', 'ad924ae6-7a96-4c31-9d74-7ab2d625a007', 'aa93ff0a-afa0-4ccb-a764-0f1f6706e92c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:52 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:21:52 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:52 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.350s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:21:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Deleted volume successfully. Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-188a47df-a4a3-4363-b007-5b66bbd16c54 tempest-ProjectReaderTests-80632435 None] Lock "cinder-9a60ccea-ed7f-4862-a089-40a7b92bf750-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:52 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f 1073741824" returned: 0 in 0.617s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Flow 'volume_create_manager' (6d952120-07b2-4dea-92bb-b8af9f77978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a2e753-82ff-4966-b30a-c0a61f4d462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a2e753-82ff-4966-b30a-c0a61f4d462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b2f1b-0168-400b-81d5-47089d0cd318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75dd5c7ccbe4ce8829b9cf177318c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:53Z,use_quota=True,user_id='485659eb304e49848cda8276f2083666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e38075-5d3f-4f51-8ebe-29bfc0bdcd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e38075-5d3f-4f51-8ebe-29bfc0bdcd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbac9d43-a465-4c06-ac25-ee93f5a2bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:52 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbac9d43-a465-4c06-ac25-ee93f5a2bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3b2f1b-0168-400b-81d5-47089d0cd318', 'volume_name': 'volume-ae3b2f1b-0168-400b-81d5-47089d0cd318', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e201547-70f5-4d56-90fa-a761d7b37205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e201547-70f5-4d56-90fa-a761d7b37205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f0204-05cb-4e01-909c-a6ada923ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Volume ae3b2f1b-0168-400b-81d5-47089d0cd318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3b2f1b-0168-400b-81d5-47089d0cd318', 'volume_size': 1} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-3a3fd0d2-554a-44fa-8fd9-198590e11c2a tempest-ProjectAdminTests-1487420962 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5200576782227, 'free_capacity_gb': 1773.5200576782227, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87367) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:53 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f Nov 04 19:21:53 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:53 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b2f1b-0168-400b-81d5-47089d0cd318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75dd5c7ccbe4ce8829b9cf177318c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:53Z,use_quota=True,user_id='485659eb304e49848cda8276f2083666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Creating volume ae3b2f1b-0168-400b-81d5-47089d0cd318 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:53 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e73076-5b36-4d4c-a5a1-998d1004c370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0572975c-ac04-4fcc-b95a-1c9e5437976f', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:53 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 1073741824 Nov 04 19:21:53 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c46969-f478-4967-875e-45a2cd33de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Volume volume-0572975c-ac04-4fcc-b95a-1c9e5437976f (0572975c-ac04-4fcc-b95a-1c9e5437976f): created successfully Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c46969-f478-4967-875e-45a2cd33de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (df906d5c-96f9-41ef-8ebd-ea9c100b5322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-60f3e4cf-4883-4db4-97e3-bde2737e7a34 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:21:53 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 1073741824" returned: 0 in 0.566s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:53 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 Nov 04 19:21:53 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:53 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (26526d39-88bf-41f6-8be3-bd947eb371cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33936bc-8389-4462-a41f-e93c1d3c2ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33936bc-8389-4462-a41f-e93c1d3c2ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530305615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2c02b-530f-4691-9b7d-d4f23b2a43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:54Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ff1250-296b-4320-9d14-f0b83ca37e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ff1250-296b-4320-9d14-f0b83ca37e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c9beac-fe68-4db9-b6a1-599fcb2fe97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c9beac-fe68-4db9-b6a1-599fcb2fe97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd2c02b-530f-4691-9b7d-d4f23b2a43b2', 'volume_name': 'volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ab6f94-6f94-49c8-8e51-d3b9ac5f1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ab6f94-6f94-49c8-8e51-d3b9ac5f1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c69016-d43e-4d77-9323-d0af8bbbcfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Volume 8bd2c02b-530f-4691-9b7d-d4f23b2a43b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2', 'volume_size': 1} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:54 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530305615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd2c02b-530f-4691-9b7d-d4f23b2a43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:54Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Creating volume 8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:54 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60f0204-05cb-4e01-909c-a6ada923ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3b2f1b-0168-400b-81d5-47089d0cd318', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 1073741824 Nov 04 19:21:54 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbc085d-42e1-4cb9-bd1a-7567a673bdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:54 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Volume volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 (ae3b2f1b-0168-400b-81d5-47089d0cd318): created successfully Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbc085d-42e1-4cb9-bd1a-7567a673bdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Flow 'volume_create_manager' (6d952120-07b2-4dea-92bb-b8af9f77978c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:54 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-06f012a6-ba10-46cc-8bf0-225c617cb390 tempest-CinderUnicodeTest-2127611254 None] Created volume successfully. Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:54 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 1073741824" returned: 0 in 0.557s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:54 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 Nov 04 19:21:54 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:55 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" returned: 0 in 0.313s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot d65c6080-00da-4f22-b31f-330167edf98d of volume 0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c69016-d43e-4d77-9323-d0af8bbbcfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055b45fa-b47f-46aa-8691-9fdc171d3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[227c440b-0023-4039-a4d7-e186358870e0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Volume volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 (8bd2c02b-530f-4691-9b7d-d4f23b2a43b2): created successfully Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055b45fa-b47f-46aa-8691-9fdc171d3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (26526d39-88bf-41f6-8be3-bd947eb371cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:55 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-25222de5-a1cb-4d57-83c0-85be326a81b0 tempest-ProjectReaderTests-80632435 None] Created volume successfully. Nov 04 19:21:55 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f Nov 04 19:21:55 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:55 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f" returned: 0 in 0.527s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:21:55 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d 1G Nov 04 19:21:55 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Flow 'volume_create_manager' (62b4004f-4745-4efc-89d9-d70ff5d8de7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64edddb1-046e-46d4-99e3-3f9b9ec8c4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64edddb1-046e-46d4-99e3-3f9b9ec8c4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-773863916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12effde-a170-4db7-860e-c662fc0cb19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75dd5c7ccbe4ce8829b9cf177318c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:56Z,use_quota=True,user_id='485659eb304e49848cda8276f2083666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11070174-72a9-4428-9082-38eba8d59f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11070174-72a9-4428-9082-38eba8d59f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d99d8d-eaf7-45ed-a23a-552ed88e6476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d99d8d-eaf7-45ed-a23a-552ed88e6476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12effde-a170-4db7-860e-c662fc0cb19d', 'volume_name': 'volume-e12effde-a170-4db7-860e-c662fc0cb19d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad06fa-a10d-46f4-95d9-329d2e1f57c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ad06fa-a10d-46f4-95d9-329d2e1f57c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb17887-3804-4dec-b991-cfc98f7a9f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:55 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Volume e12effde-a170-4db7-860e-c662fc0cb19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12effde-a170-4db7-860e-c662fc0cb19d', 'volume_size': 1} Nov 04 19:21:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:56 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d 1G" returned: 0 in 0.525s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0572975c-ac04-4fcc-b95a-1c9e5437976f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:56 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0572975c-ac04-4fcc-b95a-1c9e5437976f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d Nov 04 19:21:56 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:56 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0572975c-ac04-4fcc-b95a-1c9e5437976f -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d" returned: 0 in 0.330s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:56 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d is being set with open permissions: ugo+rw Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:56 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d Nov 04 19:21:56 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:56 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d" returned: 0 in 0.265s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:56 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info Nov 04 19:21:56 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:57 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info" returned: 0 in 0.262s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:57 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info is being set with open permissions: ugo+rw Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:57 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info Nov 04 19:21:57 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:57 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.info" returned: 0 in 0.274s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:21:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-773863916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12effde-a170-4db7-860e-c662fc0cb19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75dd5c7ccbe4ce8829b9cf177318c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:21:56Z,use_quota=True,user_id='485659eb304e49848cda8276f2083666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Creating volume e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:21:57 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:57 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d 1073741824 Nov 04 19:21:57 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-90d02f0c-6a64-490d-bde5-1f684cba9c77 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-d65c6080-00da-4f22-b31f-330167edf98d-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-d65c6080-00da-4f22-b31f-330167edf98d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-d65c6080-00da-4f22-b31f-330167edf98d" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-d65c6080-00da-4f22-b31f-330167edf98d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:21:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot d65c6080-00da-4f22-b31f-330167edf98d of volume 0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:21:58 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d 1073741824" returned: 0 in 0.544s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb8d78-c907-4a69-a210-258c758a0281]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d Nov 04 19:21:58 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:58 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d Nov 04 19:21:58 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:58 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d" returned: 0 in 0.294s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.096s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb17887-3804-4dec-b991-cfc98f7a9f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12effde-a170-4db7-860e-c662fc0cb19d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a17661-e444-4d29-b16c-c6116f588a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Creating offline snapshot e8868a13-5d7a-4eeb-ac75-d73c5b12e28f of volume 8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:21:58 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Volume volume-e12effde-a170-4db7-860e-c662fc0cb19d (e12effde-a170-4db7-860e-c662fc0cb19d): created successfully Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a17661-e444-4d29-b16c-c6116f588a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Flow 'volume_create_manager' (62b4004f-4745-4efc-89d9-d70ff5d8de7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:21:58 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad83511-137b-4542-ba55-28fb5a95f010]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d" returned: 0 in 0.438s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0572975c-ac04-4fcc-b95a-1c9e5437976f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:21:58 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e042c58c-84b4-417c-8f2b-a88ed5941f4b tempest-CinderUnicodeTest-2127611254 None] Created volume successfully. Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e319a-fc84-44ff-af7e-318ed6a64e07]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 Nov 04 19:21:58 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:58 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f Nov 04 19:21:58 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:58 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" returned: 0 in 0.443s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f 1G Nov 04 19:21:58 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:58 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f" returned: 0 in 0.421s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:58 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d Nov 04 19:21:58 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:21:59 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:59 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d Nov 04 19:21:59 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:59 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f 1G" returned: 0 in 0.611s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:59 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f Nov 04 19:21:59 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:21:59 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f.d65c6080-00da-4f22-b31f-330167edf98d" returned: 0 in 0.289s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-d65c6080-00da-4f22-b31f-330167edf98d" released by "_delete_snapshot" :: held 1.756s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" released by "delete_snapshot" :: held 1.783s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Created reservations ['048f4f66-9c06-449c-9cde-4148887ef05c', 'c35f80ad-8124-4fba-b100-fdedf360e6e0', '1d250500-8003-4a4c-a06f-e951ab29e463', '591c40cc-ddfc-49e8-a976-afd48c3cf64d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:21:59 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Nov 04 19:21:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" returned: 0 in 0.376s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:21:59 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f is being set with open permissions: ugo+rw Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:21:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-99995613-6f33-45b7-9080-96215917c2b0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-d65c6080-00da-4f22-b31f-330167edf98d-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:21:59 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f Nov 04 19:21:59 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-0572975c-ac04-4fcc-b95a-1c9e5437976f-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "cinder-0572975c-ac04-4fcc-b95a-1c9e5437976f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:00 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" acquired by "delete_volume" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a1f01-689e-4125-a99b-7043a3b4adf2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:00 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info Nov 04 19:22:00 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:00 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f Nov 04 19:22:00 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:00 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info" returned: 0 in 0.292s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:00 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info is being set with open permissions: ugo+rw Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:00 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info Nov 04 19:22:00 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:00 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f" returned: 0 in 0.436s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:00 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f Nov 04 19:22:00 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:00 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.info" returned: 0 in 0.301s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.649s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Creating offline snapshot 6d6869ff-fb53-4434-b1e8-d09e621b6ba8 of volume e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b3884-5f5e-4356-9e39-ff62cec6ed32]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b8e4355c-25b1-4d8e-b8e4-d9f1e52cd2f0 tempest-ProjectReaderTests-80632435 None] Create snapshot completed successfully Nov 04 19:22:01 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-0572975c-ac04-4fcc-b95a-1c9e5437976f" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-0572975c-ac04-4fcc-b95a-1c9e5437976f" released by "delete_volume" :: held 0.843s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:01 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d Nov 04 19:22:01 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Created reservations ['257cefe6-7b14-4e46-9285-e73435f97917', '67ed3f96-67de-4354-83df-2cf13be4adbf', 'c58a56a7-9a03-477f-9c5f-200c2e3eae0c', 'cc590c8e-4552-40c5-ac76-8518c1001717'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:01 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:01 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:01 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:01 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 1G Nov 04 19:22:01 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:01 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.406s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:01 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-ef43e77b-ccdc-4e0c-8270-f28371c62d26 tempest-ProjectMemberTests-814799006 None] Lock "cinder-0572975c-ac04-4fcc-b95a-1c9e5437976f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Deleting offline snapshot e8868a13-5d7a-4eeb-ac75-d73c5b12e28f of volume 8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] snapshot_file for this snap is: volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[58433512-784a-432a-902e-bf4fcdb7acf0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:01 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f Nov 04 19:22:01 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:01 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 1G" returned: 0 in 0.592s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12effde-a170-4db7-860e-c662fc0cb19d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:02 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12effde-a170-4db7-860e-c662fc0cb19d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 Nov 04 19:22:02 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (45018d3d-f7fa-4456-9be3-95a0733ed656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb6681b-1730-47c2-b4b5-ecc646c84052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb6681b-1730-47c2-b4b5-ecc646c84052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145081173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089fb484-f9e8-4f51-9847-6bb53f697150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:02Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c78beb-5c42-4c3d-a70f-72453c349d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c78beb-5c42-4c3d-a70f-72453c349d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fb9c82-6235-4760-8b29-7e4562146ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fb9c82-6235-4760-8b29-7e4562146ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089fb484-f9e8-4f51-9847-6bb53f697150', 'volume_name': 'volume-089fb484-f9e8-4f51-9847-6bb53f697150', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5abc78a-ed5a-47c4-a659-fa8b691110cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5abc78a-ed5a-47c4-a659-fa8b691110cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea736208-d769-42c8-a72d-7c4a43604c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:02 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Volume 089fb484-f9e8-4f51-9847-6bb53f697150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089fb484-f9e8-4f51-9847-6bb53f697150', 'volume_size': 1} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:02 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" returned: 0 in 0.458s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73711a9-3255-46e1-83eb-9d7e68c4eca2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:02 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e12effde-a170-4db7-860e-c662fc0cb19d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8" returned: 0 in 0.418s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:02 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 is being set with open permissions: ugo+rw Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:02 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 Nov 04 19:22:02 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:02 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 Nov 04 19:22:02 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:02 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8" returned: 0 in 0.298s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:02 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" returned: 0 in 0.440s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:02 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info Nov 04 19:22:02 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:02 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f Nov 04 19:22:02 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:03 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info" returned: 0 in 0.289s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:03 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info is being set with open permissions: ugo+rw Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:03 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info Nov 04 19:22:03 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:03 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" returned: 0 in 0.418s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:03 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f Nov 04 19:22:03 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:03 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.info" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145081173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089fb484-f9e8-4f51-9847-6bb53f697150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:02Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Creating volume 089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:03 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:03 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 1073741824 Nov 04 19:22:03 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d84f1931-3fac-43e3-9040-29f965b14055 tempest-CinderUnicodeTest-2127611254 None] Create snapshot completed successfully Nov 04 19:22:03 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2.e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f" released by "_delete_snapshot" :: held 1.806s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" released by "delete_snapshot" :: held 1.852s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Created reservations ['1f0a2768-9d8a-4c06-96c7-ceee91883513', '56970d6b-3318-4250-8a2e-5ae21c325b99', '74be9529-6979-4331-b5d7-423b117454e6', '3605a6ef-a2ad-4b13-b34c-0a922cc81aa1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Delete snapshot completed successfully. Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-d6c86be1-2d2d-48af-9178-bbfa21c6e361 tempest-ProjectReaderTests-80632435 None] Lock "cinder-e8868a13-5d7a-4eeb-ac75-d73c5b12e28f-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "cinder-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:03 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 1073741824" returned: 0 in 0.585s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[08838e20-5f2e-4ec8-b584-f731015ce49a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:04 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 Nov 04 19:22:04 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:04 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 Nov 04 19:22:04 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:04 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea736208-d769-42c8-a72d-7c4a43604c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089fb484-f9e8-4f51-9847-6bb53f697150', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08047aef-9b0f-4927-8ce5-fefa9d0eeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Volume volume-089fb484-f9e8-4f51-9847-6bb53f697150 (089fb484-f9e8-4f51-9847-6bb53f697150): created successfully Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08047aef-9b0f-4927-8ce5-fefa9d0eeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (45018d3d-f7fa-4456-9be3-95a0733ed656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-17634ee4-4aea-4715-a80e-481e317c2372 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:04 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:04 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2 Nov 04 19:22:04 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-6d6869ff-fb53-4434-b1e8-d09e621b6ba8-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-6d6869ff-fb53-4434-b1e8-d09e621b6ba8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-quobyte-6d6869ff-fb53-4434-b1e8-d09e621b6ba8" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-6d6869ff-fb53-4434-b1e8-d09e621b6ba8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Deleting offline snapshot 6d6869ff-fb53-4434-b1e8-d09e621b6ba8 of volume e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] snapshot_file for this snap is: volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756e229-5be7-4603-889f-8638d02c4065]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:04 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" returned: 0 in 0.299s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2" released by "delete_volume" :: held 0.791s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=235,cinder:UPDATE=311,cinder:INSERT=83,cinder:DELETE=30 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:22:04 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 Nov 04 19:22:04 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Created reservations ['51630736-caef-46e2-8bbb-6b53b2709a10', 'ce65bb14-263f-4709-964a-b44eaf84e1ea', 'cb7e37b2-eb87-4080-8ded-50bc93d34554', '77b8f68c-725c-44c0-9a10-7c21f7d3dfdd'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:04 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:04 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:05 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8" returned: 0 in 0.473s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e12effde-a170-4db7-860e-c662fc0cb19d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[45782538-85bc-47e7-a981-e62fb9f227f1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:05 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.368s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Deleted volume successfully. Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=227,cinder:UPDATE=306,cinder:INSERT=85,cinder:DELETE=27 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:22:05 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d Nov 04 19:22:05 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47e5bb6f-dc6f-4c96-a05b-dbfc59b7e921 tempest-ProjectReaderTests-80632435 None] Lock "cinder-8bd2c02b-530f-4691-9b7d-d4f23b2a43b2-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 4a465eed-cbba-4f72-9028-61e37b9d8f09 of volume 089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:05 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (d2365452-dbe6-4cdc-be42-7efdc6348534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4c85e-295f-45dc-b71a-8c15328fb220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd5ad0f-361f-4eba-bc80-5af788ccca66]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d" returned: 0 in 0.669s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4c85e-295f-45dc-b71a-8c15328fb220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088652122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f95939-5d34-46b0-a706-3c7d596f27d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:06Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82468e3-15ce-4de7-a097-fb6f52a0d703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82468e3-15ce-4de7-a097-fb6f52a0d703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:05 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 Nov 04 19:22:05 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fe014e-e0a7-41f5-8154-4678acf8cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fe014e-e0a7-41f5-8154-4678acf8cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f95939-5d34-46b0-a706-3c7d596f27d4', 'volume_name': 'volume-f5f95939-5d34-46b0-a706-3c7d596f27d4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a633fce-72b1-4903-801a-93e99bce29b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a633fce-72b1-4903-801a-93e99bce29b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffb805-7fd8-4cbc-a020-57fd17a7f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:05 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Volume f5f95939-5d34-46b0-a706-3c7d596f27d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f95939-5d34-46b0-a706-3c7d596f27d4', 'volume_size': 1} Nov 04 19:22:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:05 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 Nov 04 19:22:05 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:06 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150" returned: 0 in 0.417s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:06 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:06 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 1G Nov 04 19:22:06 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:06 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8 Nov 04 19:22:06 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:06 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d.6d6869ff-fb53-4434-b1e8-d09e621b6ba8" returned: 0 in 0.285s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-6d6869ff-fb53-4434-b1e8-d09e621b6ba8" released by "_delete_snapshot" :: held 2.013s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" released by "delete_snapshot" :: held 2.039s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Created reservations ['2d72b834-f77d-4d0a-a22b-b5639b7658e4', '6235e0d8-b330-4e31-8339-fcf2c40c0768', 'd9972812-da50-483f-b1f0-8c3dbc09eaeb', '936cb54e-65cb-48cf-b5ce-0105fb0a2dba'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Delete snapshot completed successfully. Nov 04 19:22:06 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 1G" returned: 0 in 0.519s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089fb484-f9e8-4f51-9847-6bb53f697150 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-daf64a50-c8b9-407d-83fc-a3e485194d2a tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-6d6869ff-fb53-4434-b1e8-d09e621b6ba8-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:06 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089fb484-f9e8-4f51-9847-6bb53f697150 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 Nov 04 19:22:06 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:07 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-089fb484-f9e8-4f51-9847-6bb53f697150 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09" returned: 0 in 0.308s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:07 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 is being set with open permissions: ugo+rw Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:07 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 Nov 04 19:22:07 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:07 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:07 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info Nov 04 19:22:07 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:07 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info" returned: 0 in 0.264s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:07 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info is being set with open permissions: ugo+rw Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:07 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info Nov 04 19:22:07 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-e12effde-a170-4db7-860e-c662fc0cb19d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-e12effde-a170-4db7-860e-c662fc0cb19d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:07 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.info" returned: 0 in 0.270s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088652122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f95939-5d34-46b0-a706-3c7d596f27d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:06Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Creating volume f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:07 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 1073741824 Nov 04 19:22:07 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" acquired by "delete_volume" :: waited 0.081s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac15ee-be28-4c04-9f85-dedc7d0cf28c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-00b1b2c2-aac5-4433-bc91-2aa6d92e4f6b tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:08 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d Nov 04 19:22:08 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (f1827625-7263-44d9-a3ff-cd4c5d13bbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c2b7e1-b371-46b5-a458-faa26008a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c2b7e1-b371-46b5-a458-faa26008a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446620514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd1602f-0271-4bcb-8ca1-d9fb269bfb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:08Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4fdce0-ff2f-4944-92b1-883541b2c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4fdce0-ff2f-4944-92b1-883541b2c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0404d72-cdfc-4f1a-8059-9e4afc810552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0404d72-cdfc-4f1a-8059-9e4afc810552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd1602f-0271-4bcb-8ca1-d9fb269bfb88', 'volume_name': 'volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442171c-f6ec-4558-83c5-ad7fcc23c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e442171c-f6ec-4558-83c5-ad7fcc23c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c89c0d-83cf-4e84-9859-181fc65a3737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Volume dfd1602f-0271-4bcb-8ca1-d9fb269bfb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88', 'volume_size': 1} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:08 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 1073741824" returned: 0 in 0.483s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:08 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d" returned: 0 in 0.442s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:08 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 Nov 04 19:22:08 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:08 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d Nov 04 19:22:08 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:08 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-4a465eed-cbba-4f72-9028-61e37b9d8f09-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:08 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446620514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd1602f-0271-4bcb-8ca1-d9fb269bfb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:08Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Creating volume dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:08 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e12effde-a170-4db7-860e-c662fc0cb19d" returned: 0 in 0.298s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:08 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 1073741824 Nov 04 19:22:08 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-4a465eed-cbba-4f72-9028-61e37b9d8f09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffb805-7fd8-4cbc-a020-57fd17a7f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f95939-5d34-46b0-a706-3c7d596f27d4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedc4111-ab49-4e9a-8df7-b8c4f1e253d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-e12effde-a170-4db7-860e-c662fc0cb19d" released by "delete_volume" :: held 0.848s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-4a465eed-cbba-4f72-9028-61e37b9d8f09" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Volume volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 (f5f95939-5d34-46b0-a706-3c7d596f27d4): created successfully Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedc4111-ab49-4e9a-8df7-b8c4f1e253d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (d2365452-dbe6-4cdc-be42-7efdc6348534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-4a465eed-cbba-4f72-9028-61e37b9d8f09" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 4a465eed-cbba-4f72-9028-61e37b9d8f09 of volume 089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-f1bcb141-e419-47c4-8858-566a0c1079e3 tempest-ProjectReaderTests-80632435 None] Created volume successfully. Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[604882d4-9650-4d1c-941e-30e573833017]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:08 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Created reservations ['865ab187-163c-4d12-987e-75e8e46c71c6', '49656aae-a39b-4548-b589-b8f7a31f62c7', 'e65be001-dc04-4bf2-8e5f-dad07ce76bbb', '9d3338c7-49cf-4c04-9029-337fddd395f6'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:09 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 Nov 04 19:22:09 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-ae3b2f1b-0168-400b-81d5-47089d0cd318-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-ae3b2f1b-0168-400b-81d5-47089d0cd318-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "cinder-quobyte-ae3b2f1b-0168-400b-81d5-47089d0cd318" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-ae3b2f1b-0168-400b-81d5-47089d0cd318" acquired by "delete_volume" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786121c-ef32-4176-ac6a-5874ec49b95c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Deleted volume successfully. Nov 04 19:22:09 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 1073741824" returned: 0 in 0.703s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e720c9e1-534e-41bc-8415-853b05d236e1 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-e12effde-a170-4db7-860e-c662fc0cb19d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:09 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 Nov 04 19:22:09 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 Nov 04 19:22:09 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09" returned: 0 in 0.652s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-089fb484-f9e8-4f51-9847-6bb53f697150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13391ee-5833-4e45-a6b5-e98156d002d6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 Nov 04 19:22:09 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318" returned: 0 in 0.420s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" returned: 0 in 0.299s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:09 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318 Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:09 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c89c0d-83cf-4e84-9859-181fc65a3737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaa9a4a-e732-42c4-adcb-64e16fd5ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Creating offline snapshot f8f7ab41-d7ff-44f9-a5c2-56dca9904848 of volume f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:09 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Volume volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 (dfd1602f-0271-4bcb-8ca1-d9fb269bfb88): created successfully Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaa9a4a-e732-42c4-adcb-64e16fd5ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (f1827625-7263-44d9-a3ff-cd4c5d13bbf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5357c6d-7eed-4f66-91b0-e10c559328cf]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-db0a639a-b346-4fd2-ac09-81934e956e79 tempest-ProjectReaderTests-749876145 None] Created volume successfully. Nov 04 19:22:09 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 Nov 04 19:22:09 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:09 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150" returned: 0 in 0.432s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-ae3b2f1b-0168-400b-81d5-47089d0cd318" returned: 0 in 0.281s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 Nov 04 19:22:10 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-quobyte-ae3b2f1b-0168-400b-81d5-47089d0cd318" released by "delete_volume" :: held 0.766s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Created reservations ['208e3ca3-f318-435c-ac8d-0716a5953d6e', '22103c11-61d3-4b2c-aea3-13cd26d7c886', '643d393e-df2b-4e73-9344-3ae5deaf5678', '05a2de9e-0462-4576-bcf4-85031673501f'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:10 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4" returned: 0 in 0.435s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 1G Nov 04 19:22:10 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Deleted volume successfully. Nov 04 19:22:10 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09" returned: 0 in 0.511s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09 Nov 04 19:22:10 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c47a5a4c-0acc-4d03-a1df-c39f6e5fa981 tempest-CinderUnicodeTest-2127611254 None] Lock "cinder-ae3b2f1b-0168-400b-81d5-47089d0cd318-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-quobyte-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" acquired by "delete_volume" :: waited 0.024s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da6a03-df30-4e0c-8087-c849411c86bd]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150.4a465eed-cbba-4f72-9028-61e37b9d8f09" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 1G" returned: 0 in 0.647s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:10 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 Nov 04 19:22:10 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 Nov 04 19:22:10 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-4a465eed-cbba-4f72-9028-61e37b9d8f09" released by "_delete_snapshot" :: held 2.172s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" released by "delete_snapshot" :: held 2.215s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Created reservations ['f2b9b64f-d435-49ed-abd6-98d53265dca7', 'f53a3f59-f945-44d0-b84b-ef8801251586', '8680a5f5-5215-4e4e-bceb-fe6942540a76', 'eb2efedb-8c09-4ecb-88ce-dab7956bc210'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:11 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-e4266767-5967-4b7d-903d-b0108ca0f50e tempest-ProjectMemberTests-814799006 None] Lock "cinder-4a465eed-cbba-4f72-9028-61e37b9d8f09-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:11 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" returned: 0 in 0.444s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:11 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88 Nov 04 19:22:11 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:11 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848" returned: 0 in 0.396s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:11 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 is being set with open permissions: ugo+rw Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:11 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 Nov 04 19:22:11 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:11 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" returned: 0 in 0.309s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88" released by "delete_volume" :: held 0.821s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:11 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848" returned: 0 in 0.282s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:11 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info Nov 04 19:22:11 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Created reservations ['50a12f39-2243-4a6e-be72-885a0d647f21', '0657451c-b421-44c8-b1f0-98fb6cba9dff', '6e0e6c56-a267-47ce-8959-adf54ed99834', '33d2efd7-126c-41f6-9977-838da855c0f8'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:11 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:11 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:11 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info" returned: 0 in 0.310s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:11 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info is being set with open permissions: ugo+rw Nov 04 19:22:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:11 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info Nov 04 19:22:11 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-089fb484-f9e8-4f51-9847-6bb53f697150-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "cinder-089fb484-f9e8-4f51-9847-6bb53f697150-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:12 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.396s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Deleted volume successfully. Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-9a33584d-b6ca-46b2-85c2-d296bfab78a4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-dfd1602f-0271-4bcb-8ca1-d9fb269bfb88-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" acquired by "delete_volume" :: waited 0.034s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:12 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.info" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e9bfb-499d-4f89-b417-06a611af1dd4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-00f69809-5c13-4491-9a42-dfd3185c5807 tempest-ProjectReaderTests-80632435 None] Create snapshot completed successfully Nov 04 19:22:12 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 Nov 04 19:22:12 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (910ffdb9-067e-4422-897e-41d4585d0217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61026bbf-fc0d-4166-b94a-6068581bcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61026bbf-fc0d-4166-b94a-6068581bcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870293807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbb1169-6239-4833-868f-91a42e7ea630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:13Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038fcd70-3991-4726-b21e-a6d990cd982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038fcd70-3991-4726-b21e-a6d990cd982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8f4406-4aa0-4660-8d2f-6ec27c738abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8f4406-4aa0-4660-8d2f-6ec27c738abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdbb1169-6239-4833-868f-91a42e7ea630', 'volume_name': 'volume-cdbb1169-6239-4833-868f-91a42e7ea630', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef398d5b-8b56-41c0-8b24-5d49a4b71480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef398d5b-8b56-41c0-8b24-5d49a4b71480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952f15d6-46c1-4fde-9925-2965ddaf09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:12 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Volume cdbb1169-6239-4833-868f-91a42e7ea630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdbb1169-6239-4833-868f-91a42e7ea630', 'volume_size': 1} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870293807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbb1169-6239-4833-868f-91a42e7ea630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:13Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Creating volume cdbb1169-6239-4833-868f-91a42e7ea630 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:12 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:12 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 1073741824 Nov 04 19:22:12 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:12 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150" returned: 0 in 0.426s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:12 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150 Nov 04 19:22:12 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:13 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-089fb484-f9e8-4f51-9847-6bb53f697150" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-089fb484-f9e8-4f51-9847-6bb53f697150" released by "delete_volume" :: held 0.825s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Created reservations ['9048966d-041e-4e5d-ba9b-a36a2ab282f3', '878c1044-2059-4b87-b272-9722b6f976cc', '56e71daf-ccdb-4920-b7d6-3c62f0f6f53a', 'e1f08a9b-790b-41ff-a841-9c12dadf0cef'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:13 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 1073741824" returned: 0 in 0.543s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:13 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:13 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:13 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 Nov 04 19:22:13 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-f8f7ab41-d7ff-44f9-a5c2-56dca9904848-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-f8f7ab41-d7ff-44f9-a5c2-56dca9904848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-f8f7ab41-d7ff-44f9-a5c2-56dca9904848" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f8f7ab41-d7ff-44f9-a5c2-56dca9904848" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Deleting offline snapshot f8f7ab41-d7ff-44f9-a5c2-56dca9904848 of volume f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] snapshot_file for this snap is: volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:13 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.488s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[31783a10-5411-4550-bf18-ab13395b3fb2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:13 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630" returned: 0 in 0.483s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952f15d6-46c1-4fde-9925-2965ddaf09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbb1169-6239-4833-868f-91a42e7ea630', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d4b2d6-e589-4299-a30e-9a6f3755d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2023d32a-a403-4417-a3b3-56079e845d52 tempest-ProjectMemberTests-814799006 None] Lock "cinder-089fb484-f9e8-4f51-9847-6bb53f697150-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:13 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Volume volume-cdbb1169-6239-4833-868f-91a42e7ea630 (cdbb1169-6239-4833-868f-91a42e7ea630): created successfully Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d4b2d6-e589-4299-a30e-9a6f3755d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (910ffdb9-067e-4422-897e-41d4585d0217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8eb49c02-494b-4537-bdc7-d9ebabbe3d85 tempest-ProjectReaderTests-749876145 None] Created volume successfully. Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:13 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 Nov 04 19:22:13 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (afa2edde-aa5f-4652-a203-b9341f50c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268d9fe-fb8f-43c1-bbf0-00129aebc00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:13 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1268d9fe-fb8f-43c1-bbf0-00129aebc00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325664306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cae921-f38a-40bc-b711-747ee54774ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:14Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8575ae1-0fbb-43d6-b85b-751fb5b50ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8575ae1-0fbb-43d6-b85b-751fb5b50ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf018f6-afa2-4357-ae42-62f8e202c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf018f6-afa2-4357-ae42-62f8e202c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cae921-f38a-40bc-b711-747ee54774ef', 'volume_name': 'volume-95cae921-f38a-40bc-b711-747ee54774ef', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8446ba47-8b0a-44eb-b811-aa212d043f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8446ba47-8b0a-44eb-b811-aa212d043f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb01c423-cfab-430f-9c4c-8b0d482a11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Volume 95cae921-f38a-40bc-b711-747ee54774ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cae921-f38a-40bc-b711-747ee54774ef', 'volume_size': 1} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325664306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cae921-f38a-40bc-b711-747ee54774ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:14Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Creating volume 95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:14 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:14 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef 1073741824 Nov 04 19:22:14 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:14 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848" returned: 0 in 0.441s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5f95939-5d34-46b0-a706-3c7d596f27d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[47186839-4830-4314-a762-cc0007d65b22]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:14 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 Nov 04 19:22:14 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:14 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef 1073741824" returned: 0 in 0.481s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:14 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef Nov 04 19:22:14 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:14 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:14 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 Nov 04 19:22:14 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:14 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef" returned: 0 in 0.292s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb01c423-cfab-430f-9c4c-8b0d482a11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cae921-f38a-40bc-b711-747ee54774ef', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62acef5-a67f-45f1-9b58-7a521ac42c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:14 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Volume volume-95cae921-f38a-40bc-b711-747ee54774ef (95cae921-f38a-40bc-b711-747ee54774ef): created successfully Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62acef5-a67f-45f1-9b58-7a521ac42c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:14 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (afa2edde-aa5f-4652-a203-b9341f50c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:14 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-96e4ecad-191c-4d30-aad6-e7c9a0d76807 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-cdbb1169-6239-4833-868f-91a42e7ea630-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "cinder-cdbb1169-6239-4833-868f-91a42e7ea630-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-quobyte-cdbb1169-6239-4833-868f-91a42e7ea630" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-cdbb1169-6239-4833-868f-91a42e7ea630" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[46258bf0-4c74-4844-9778-bef422753e5f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:15 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848" returned: 0 in 0.500s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:15 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848 Nov 04 19:22:15 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:15 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 Nov 04 19:22:15 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:15 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4.f8f7ab41-d7ff-44f9-a5c2-56dca9904848" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f8f7ab41-d7ff-44f9-a5c2-56dca9904848" released by "_delete_snapshot" :: held 1.789s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" released by "delete_snapshot" :: held 1.840s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:15 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630" returned: 0 in 0.405s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:15 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630 Nov 04 19:22:15 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Created reservations ['408e039c-9626-46db-9091-a4980117589b', '292116f9-1850-4d2c-8537-2914479c6d72', '152381e7-eb5c-439b-a236-6f98ca6713ad', '30712e2c-f488-4a5e-afbd-c60da6d8c08d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:15 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Delete snapshot completed successfully. Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-84c02b97-ac3e-4485-86a3-473726d1c789 tempest-ProjectReaderTests-80632435 None] Lock "cinder-f8f7ab41-d7ff-44f9-a5c2-56dca9904848-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:15 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-cdbb1169-6239-4833-868f-91a42e7ea630" returned: 0 in 0.270s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-cdbb1169-6239-4833-868f-91a42e7ea630" released by "delete_volume" :: held 0.728s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Created reservations ['8a6ad5c0-7cd7-4d8d-a405-fdadee0b827e', 'f4d12f99-475c-435f-ac94-110558a5949d', 'eea78b23-f180-4814-9e44-f8dac7ac7d02', '9a497fa9-7911-4201-b52f-13f28c8433cf'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-f5f95939-5d34-46b0-a706-3c7d596f27d4-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "cinder-f5f95939-5d34-46b0-a706-3c7d596f27d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:15 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:16 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:16 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfbe390-0ddf-4d89-a27e-ff214619adf4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:16 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 Nov 04 19:22:16 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:16 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.286s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:16 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Deleted volume successfully. Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-a6d4ca62-5a98-404b-bd4f-9b81cf1c7723 tempest-ProjectReaderTests-749876145 None] Lock "cinder-cdbb1169-6239-4833-868f-91a42e7ea630-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 5c5eec04-a452-4936-9f24-8fb869c63fa5 of volume 95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a24610-99f4-4c52-85db-dbe3792db865]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:16 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4" returned: 0 in 0.466s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:16 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4 Nov 04 19:22:16 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:16 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef Nov 04 19:22:16 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:16 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (f4d8bc7d-3673-40e6-adbe-7754e369d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5715d8f-ce6d-4ade-9c7c-2ba1ea878789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-f5f95939-5d34-46b0-a706-3c7d596f27d4" returned: 0 in 0.413s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:16 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5715d8f-ce6d-4ade-9c7c-2ba1ea878789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819204584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32da9a-7117-4bf5-845a-d8ca0044a7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:17Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ad92ed-aa31-4715-a8e9-62abd98dee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ad92ed-aa31-4715-a8e9-62abd98dee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5378c1c-2c71-4d49-9645-7e1198e137f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5378c1c-2c71-4d49-9645-7e1198e137f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e32da9a-7117-4bf5-845a-d8ca0044a7f4', 'volume_name': 'volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2e1e09-dcb2-45cb-99c8-025f3b40232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2e1e09-dcb2-45cb-99c8-025f3b40232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e503d84-b8cb-4068-a021-4d054bb0cee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Volume 5e32da9a-7117-4bf5-845a-d8ca0044a7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4', 'volume_size': 1} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-f5f95939-5d34-46b0-a706-3c7d596f27d4" released by "delete_volume" :: held 1.047s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:17 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef" returned: 0 in 0.589s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:17 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 1G Nov 04 19:22:17 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Created reservations ['e2730598-554e-4934-ae1d-353bbda60296', 'a680368b-c981-4595-a2f2-837a9b12dcfa', '007e4067-1f36-4cda-9597-80c989d44a2d', '760a4b95-447a-4e71-b457-d34aef966a06'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:17 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:17 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:17 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:17 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Deleted volume successfully. Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-47b2af20-28f9-408b-afb4-1fb8a2fcf1b6 tempest-ProjectReaderTests-80632435 None] Lock "cinder-f5f95939-5d34-46b0-a706-3c7d596f27d4-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 1G" returned: 0 in 0.490s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cae921-f38a-40bc-b711-747ee54774ef -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:17 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cae921-f38a-40bc-b711-747ee54774ef -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 Nov 04 19:22:17 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:17 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cae921-f38a-40bc-b711-747ee54774ef -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:17 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 is being set with open permissions: ugo+rw Nov 04 19:22:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:17 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 Nov 04 19:22:17 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:18 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5" returned: 0 in 0.263s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:18 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info Nov 04 19:22:18 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:18 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:18 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info is being set with open permissions: ugo+rw Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:18 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info Nov 04 19:22:18 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (006ae983-6d20-4704-9ef7-9d3c55b982bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6720b-d4ec-413b-a102-6edff6e9fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6720b-d4ec-413b-a102-6edff6e9fba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222897265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b6bd96-f580-401b-a138-1effed346666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:19Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a285b9-a96c-4a03-b13e-f5e498160097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a285b9-a96c-4a03-b13e-f5e498160097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3c6f1e-58ad-4f9c-b77f-cc73b757f8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3c6f1e-58ad-4f9c-b77f-cc73b757f8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b6bd96-f580-401b-a138-1effed346666', 'volume_name': 'volume-46b6bd96-f580-401b-a138-1effed346666', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3be55-1e39-4aa0-a0c9-c2ca21b6ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3be55-1e39-4aa0-a0c9-c2ca21b6ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12e609e-7f7d-4c80-8911-0cdd5c1df890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Volume 46b6bd96-f580-401b-a138-1effed346666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b6bd96-f580-401b-a138-1effed346666', 'volume_size': 1} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:18 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.info" returned: 0 in 0.271s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819204584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32da9a-7117-4bf5-845a-d8ca0044a7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:17Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Creating volume 5e32da9a-7117-4bf5-845a-d8ca0044a7f4 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:18 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:18 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 1073741824 Nov 04 19:22:18 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-97d902ae-db8f-4163-94e2-5856b04c7e0c tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:19 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 1073741824" returned: 0 in 0.469s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:19 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 Nov 04 19:22:19 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:19 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" returned: 0 in 0.304s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222897265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b6bd96-f580-401b-a138-1effed346666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:19Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Creating volume 46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:19 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:19 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 1073741824 Nov 04 19:22:19 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e503d84-b8cb-4068-a021-4d054bb0cee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b34292-efbc-4537-b2db-2ff4e73454cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:19 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Volume volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 (5e32da9a-7117-4bf5-845a-d8ca0044a7f4): created successfully Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b34292-efbc-4537-b2db-2ff4e73454cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (f4d8bc7d-3673-40e6-adbe-7754e369d89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-5c5eec04-a452-4936-9f24-8fb869c63fa5-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-d9c3cf34-be58-4d38-8231-c235480b2e4a tempest-ProjectReaderTests-749876145 None] Created volume successfully. Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-5c5eec04-a452-4936-9f24-8fb869c63fa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-5c5eec04-a452-4936-9f24-8fb869c63fa5" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5c5eec04-a452-4936-9f24-8fb869c63fa5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 5c5eec04-a452-4936-9f24-8fb869c63fa5 of volume 95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba28bb9-bef5-446d-8049-7ebcbee2c8c8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 Nov 04 19:22:20 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-5e32da9a-7117-4bf5-845a-d8ca0044a7f4-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-5e32da9a-7117-4bf5-845a-d8ca0044a7f4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-quobyte-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" acquired by "delete_volume" :: waited 0.027s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a806a-9309-42ec-85fe-a11e2a7d78f0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 1073741824" returned: 0 in 0.579s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 Nov 04 19:22:20 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:20 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:20 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 Nov 04 19:22:20 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5" returned: 0 in 0.456s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95cae921-f38a-40bc-b711-747ee54774ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001d6ac-3bf4-475e-9801-c0c653f99395]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef Nov 04 19:22:20 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:20 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666" returned: 0 in 0.264s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12e609e-7f7d-4c80-8911-0cdd5c1df890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b6bd96-f580-401b-a138-1effed346666', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d6c2ea-fb99-47d3-8022-1d237aeca31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Volume volume-46b6bd96-f580-401b-a138-1effed346666 (46b6bd96-f580-401b-a138-1effed346666): created successfully Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d6c2ea-fb99-47d3-8022-1d237aeca31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (006ae983-6d20-4704-9ef7-9d3c55b982bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:20 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-92cc9a66-7117-40f7-9806-4e9383cdd340 tempest-ProjectReaderTests-80632435 None] Created volume successfully. Nov 04 19:22:20 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" returned: 0 in 0.430s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4 Nov 04 19:22:20 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:20 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef" returned: 0 in 0.447s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:20 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 Nov 04 19:22:20 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:21 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Creating offline snapshot 126a4210-0434-4ed7-b239-032c28397326 of volume 46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" returned: 0 in 0.421s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-5e32da9a-7117-4bf5-845a-d8ca0044a7f4" released by "delete_volume" :: held 0.896s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbef1cd-271e-4743-a91c-5580ca44564d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Created reservations ['e33ce62f-50e8-4814-a83b-3ae27999f72a', 'eadc5e85-a324-4ffa-be73-422cf4b608e6', '4954c981-950a-4ed2-8e00-ad62d6db8785', '04a5a170-559a-4d56-92c6-28b623c58e6e'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:21 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 Nov 04 19:22:21 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:21 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:21 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:21 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5" returned: 0 in 0.591s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:21 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5 Nov 04 19:22:21 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:21 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.290s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Deleted volume successfully. Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-edbda7ed-9183-4894-a939-b487f0482fa4 tempest-ProjectReaderTests-749876145 None] Lock "cinder-5e32da9a-7117-4bf5-845a-d8ca0044a7f4-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:21 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666" returned: 0 in 0.588s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:21 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 1G Nov 04 19:22:21 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:21 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef.5c5eec04-a452-4936-9f24-8fb869c63fa5" returned: 0 in 0.504s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5c5eec04-a452-4936-9f24-8fb869c63fa5" released by "_delete_snapshot" :: held 2.138s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" released by "delete_snapshot" :: held 2.178s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (49ac3558-de63-43c2-9a9e-e2893b77d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e110b4ec-2842-4ef2-8eda-1b99bd555a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e110b4ec-2842-4ef2-8eda-1b99bd555a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298992706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dafc843-5481-40e5-bc75-39563ad6eeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:22Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2cdb22-c61f-49ad-90db-12b6694feb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2cdb22-c61f-49ad-90db-12b6694feb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d467ef1-e722-4ac2-853b-da2e2b0ccad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d467ef1-e722-4ac2-853b-da2e2b0ccad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dafc843-5481-40e5-bc75-39563ad6eeb2', 'volume_name': 'volume-2dafc843-5481-40e5-bc75-39563ad6eeb2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670e7fd2-0aa7-44d0-a57d-dc1233ce889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670e7fd2-0aa7-44d0-a57d-dc1233ce889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f8202b-ac8c-4749-8003-4f90cce721fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:22 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Volume 2dafc843-5481-40e5-bc75-39563ad6eeb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dafc843-5481-40e5-bc75-39563ad6eeb2', 'volume_size': 1} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Created reservations ['134c218d-d0bc-4c81-a08b-313ea7e97c99', '10b00625-fb2c-4656-80bb-4eb83851dea5', 'df70eacb-5945-4b9b-8878-09050756ca2e', '41605a03-b054-45a4-924e-ac4a4d9dd00c'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:22 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 1G" returned: 0 in 0.578s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b6bd96-f580-401b-a138-1effed346666 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:22 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:22 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0b250285-a8ab-4868-9f49-2898d0932c4a tempest-ProjectMemberTests-814799006 None] Lock "cinder-5c5eec04-a452-4936-9f24-8fb869c63fa5-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:22 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b6bd96-f580-401b-a138-1effed346666 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 Nov 04 19:22:22 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:22 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:22:22 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b6bd96-f580-401b-a138-1effed346666 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326" returned: 0 in 0.344s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:22 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 is being set with open permissions: ugo+rw Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:22 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 Nov 04 19:22:22 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:22 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326" returned: 0 in 0.261s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:22 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info Nov 04 19:22:22 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-95cae921-f38a-40bc-b711-747ee54774ef-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:23 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:23 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info is being set with open permissions: ugo+rw Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "cinder-95cae921-f38a-40bc-b711-747ee54774ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:23 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info Nov 04 19:22:23 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[461845f3-46b2-4a69-995e-f28bd37b7aab]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:23 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef Nov 04 19:22:23 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:23 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.info" returned: 0 in 0.291s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298992706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dafc843-5481-40e5-bc75-39563ad6eeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374bc2359f454dac8fde9c386971e349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:22Z,use_quota=True,user_id='88f09ab1a0d942ef974be65c9fefd4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Creating volume 2dafc843-5481-40e5-bc75-39563ad6eeb2 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:23 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:23 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 1073741824 Nov 04 19:22:23 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:23 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ed2101f2-1460-4c1b-8547-c2246ec1afe2 tempest-ProjectReaderTests-80632435 None] Create snapshot completed successfully Nov 04 19:22:23 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef" returned: 0 in 0.441s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:23 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:23 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef Nov 04 19:22:23 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:24 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 1073741824" returned: 0 in 0.513s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:24 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-95cae921-f38a-40bc-b711-747ee54774ef" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-95cae921-f38a-40bc-b711-747ee54774ef" released by "delete_volume" :: held 0.839s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:24 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 Nov 04 19:22:24 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Created reservations ['1f98388e-d616-417e-873d-397a62a5ab9a', '25e26fe7-8468-4156-bd8b-444139d24083', 'f3c281dd-6b2e-4e26-82f0-fc196a3a753b', 'c740a350-79ef-4ce1-bd0c-4d9ccbd36683'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-126a4210-0434-4ed7-b239-032c28397326-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:24 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:24 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-126a4210-0434-4ed7-b239-032c28397326-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-126a4210-0434-4ed7-b239-032c28397326" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-126a4210-0434-4ed7-b239-032c28397326" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Deleting offline snapshot 126a4210-0434-4ed7-b239-032c28397326 of volume 46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] snapshot_file for this snap is: volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[64087208-59fe-406c-90ba-2c37e595589a]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:24 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2" returned: 0 in 0.398s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f8202b-ac8c-4749-8003-4f90cce721fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dafc843-5481-40e5-bc75-39563ad6eeb2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf479d80-1782-450c-8fa3-1fb661dd65e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:24 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Volume volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 (2dafc843-5481-40e5-bc75-39563ad6eeb2): created successfully Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf479d80-1782-450c-8fa3-1fb661dd65e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Flow 'volume_create_manager' (49ac3558-de63-43c2-9a9e-e2893b77d329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:24 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-55f6641b-a6ca-433f-992a-3fd3956d3228 tempest-ProjectReaderTests-749876145 None] Created volume successfully. Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:24 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 Nov 04 19:22:24 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:24 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4308ff07-a299-4591-a95b-cddff5423615 tempest-ProjectMemberTests-814799006 None] Lock "cinder-95cae921-f38a-40bc-b711-747ee54774ef-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:24 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326" returned: 0 in 0.492s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46b6bd96-f580-401b-a138-1effed346666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943e363-0599-4c7a-b909-9194461b2e35]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:24 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (ff2c853a-9f3c-4b40-8688-3471625e9699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d325f9-07b9-41d3-91f5-b393c6a7403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d325f9-07b9-41d3-91f5-b393c6a7403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456705378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bac3e7b-f6a5-4c7b-a556-5f392a6c7742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:25Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f5d97a-d345-4db3-92df-f0e93b071c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f5d97a-d345-4db3-92df-f0e93b071c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daee9687-213e-4e5c-a4c5-faf42c0c4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daee9687-213e-4e5c-a4c5-faf42c0c4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bac3e7b-f6a5-4c7b-a556-5f392a6c7742', 'volume_name': 'volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:25 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 Nov 04 19:22:25 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db65ce39-98c3-40d5-ab8b-432485f5fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db65ce39-98c3-40d5-ab8b-432485f5fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794cc9ff-8193-4c9d-8a87-ceac1bc6bcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:25 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Volume 5bac3e7b-f6a5-4c7b-a556-5f392a6c7742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742', 'volume_size': 1} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-456705378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bac3e7b-f6a5-4c7b-a556-5f392a6c7742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:25Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Creating volume 5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:25 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 1073741824 Nov 04 19:22:25 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-2dafc843-5481-40e5-bc75-39563ad6eeb2-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "cinder-2dafc843-5481-40e5-bc75-39563ad6eeb2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Acquiring lock "cinder-quobyte-2dafc843-5481-40e5-bc75-39563ad6eeb2" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-2dafc843-5481-40e5-bc75-39563ad6eeb2" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9d2e2e-a439-4d38-b06c-2b4b55db8aa1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666" returned: 0 in 0.514s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 Nov 04 19:22:25 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:25 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 Nov 04 19:22:25 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:25 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 1073741824" returned: 0 in 0.585s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 Nov 04 19:22:25 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:25 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2" returned: 0 in 0.488s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:25 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:25 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2 Nov 04 19:22:25 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:26 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326" returned: 0 in 0.509s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:26 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326 Nov 04 19:22:26 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:26 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" returned: 0 in 0.351s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794cc9ff-8193-4c9d-8a87-ceac1bc6bcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be2e85c-261a-400d-a9e1-0d9dae8ef607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:26 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Volume volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 (5bac3e7b-f6a5-4c7b-a556-5f392a6c7742): created successfully Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be2e85c-261a-400d-a9e1-0d9dae8ef607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (ff2c853a-9f3c-4b40-8688-3471625e9699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:26 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2dafc843-5481-40e5-bc75-39563ad6eeb2" returned: 0 in 0.314s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-97ee5566-2f38-45d5-843f-a8a89c16b11a tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "cinder-quobyte-2dafc843-5481-40e5-bc75-39563ad6eeb2" released by "delete_volume" :: held 0.878s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Created reservations ['19f18387-4f83-47ff-b730-9d2a8dfdd8b2', 'fc0962d7-5390-4526-8400-78e9dbe95bc8', 'dc1dcd45-6804-48c4-b7f2-3d149dec8471', '0f07c4e8-ae30-45bd-b904-6be57421bdb1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:26 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:26 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:26 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666.126a4210-0434-4ed7-b239-032c28397326" returned: 0 in 0.363s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-126a4210-0434-4ed7-b239-032c28397326" released by "_delete_snapshot" :: held 2.067s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" released by "delete_snapshot" :: held 2.097s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Created reservations ['687ea4c4-5ec8-47aa-aee5-9fa429bbf7bb', '5d6853ec-ec02-439f-94be-14c521850487', 'a07de14a-343e-43d5-a05a-86c9de14e4c9', 'a8718e08-40dd-43db-aa7f-e4e26073e1d0'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Delete snapshot completed successfully. Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-eeeecaa3-5b40-4209-bd5c-b3f309ddfab0 tempest-ProjectReaderTests-80632435 None] Lock "cinder-126a4210-0434-4ed7-b239-032c28397326-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:26 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.280s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:26 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Deleted volume successfully. Nov 04 19:22:26 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-de100b7d-5448-445e-99df-7d006b576288 tempest-ProjectReaderTests-749876145 None] Lock "cinder-2dafc843-5481-40e5-bc75-39563ad6eeb2-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 9ba543a4-ffea-4fca-891a-0080e65b5858 of volume 5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac26c0c-b794-4ee3-9dfa-6b414a8da180]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:27 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 Nov 04 19:22:27 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-46b6bd96-f580-401b-a138-1effed346666-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "cinder-46b6bd96-f580-401b-a138-1effed346666-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[666466fc-006f-4aae-a00a-a664492685f4]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:27 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" returned: 0 in 0.505s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:27 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:27 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 Nov 04 19:22:27 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:27 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 1G Nov 04 19:22:27 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:28 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666" returned: 0 in 0.505s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:28 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666 Nov 04 19:22:28 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:28 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 1G" returned: 0 in 0.576s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:28 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 Nov 04 19:22:28 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:28 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-46b6bd96-f580-401b-a138-1effed346666" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-46b6bd96-f580-401b-a138-1effed346666" released by "delete_volume" :: held 1.007s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Created reservations ['a3c4729b-09c1-4eae-b6ff-efb90a2a2868', '29fa4682-cdda-45d7-8fd8-47e0bdbabe92', '5fdb7119-be93-4dca-909e-07eb75acde53', '10c1b36d-2d6a-41db-b7b3-360053dbf939'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:28 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858" returned: 0 in 0.395s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:28 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 is being set with open permissions: ugo+rw Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:28 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 Nov 04 19:22:28 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:28 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:28 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:28 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:29 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:29 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Deleted volume successfully. Nov 04 19:22:29 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info Nov 04 19:22:29 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4ea18da0-dc9e-48df-a16f-b04f565328b8 tempest-ProjectReaderTests-80632435 None] Lock "cinder-46b6bd96-f580-401b-a138-1effed346666-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:29 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:29 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info is being set with open permissions: ugo+rw Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:29 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info Nov 04 19:22:29 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:29 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.info" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:29 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:29 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-5e845eba-0a82-4039-af4d-0f3cda65fe75 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (05cae57b-c854-4513-a42f-8a8fc110e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717cde5-381b-4e11-8069-b9037944b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c717cde5-381b-4e11-8069-b9037944b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085765015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a364af-f1bc-45e9-931b-7ece6c5bab94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:30Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d9eac9-c74f-4594-b321-93fbbf79dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d9eac9-c74f-4594-b321-93fbbf79dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3def7b-cc42-4ed0-8457-37b884db97f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3def7b-cc42-4ed0-8457-37b884db97f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a364af-f1bc-45e9-931b-7ece6c5bab94', 'volume_name': 'volume-76a364af-f1bc-45e9-931b-7ece6c5bab94', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0ecec7-71cf-4218-95d2-60d888dadc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0ecec7-71cf-4218-95d2-60d888dadc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2001d13-4f56-48a2-af2b-02e7494e2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:30 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Volume 76a364af-f1bc-45e9-931b-7ece6c5bab94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a364af-f1bc-45e9-931b-7ece6c5bab94', 'volume_size': 1} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085765015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a364af-f1bc-45e9-931b-7ece6c5bab94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed7c5d221494fd48842b751aa57707f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:30Z,use_quota=True,user_id='9ae1d51f77b34441af2b74edef97edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Creating volume 76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:30 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:30 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 1073741824 Nov 04 19:22:30 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-9ba543a4-ffea-4fca-891a-0080e65b5858-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-9ba543a4-ffea-4fca-891a-0080e65b5858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-9ba543a4-ffea-4fca-891a-0080e65b5858" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-9ba543a4-ffea-4fca-891a-0080e65b5858" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 9ba543a4-ffea-4fca-891a-0080e65b5858 of volume 5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e4933-16e0-4f11-bec4-2fa653ef8263]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:30 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:30 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 Nov 04 19:22:30 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:31 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 1073741824" returned: 0 in 0.511s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:31 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 Nov 04 19:22:31 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:31 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858" returned: 0 in 0.433s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5499d1-30b2-4393-b0ca-4373b7743430]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:31 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 Nov 04 19:22:31 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:31 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94" returned: 0 in 0.300s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2001d13-4f56-48a2-af2b-02e7494e2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a364af-f1bc-45e9-931b-7ece6c5bab94', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7f5901-3cf8-4879-91c3-1021d3b2278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:31 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Volume volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 (76a364af-f1bc-45e9-931b-7ece6c5bab94): created successfully Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7f5901-3cf8-4879-91c3-1021d3b2278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Flow 'volume_create_manager' (05cae57b-c854-4513-a42f-8a8fc110e30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:31 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-191fd457-15e7-41f4-b7b7-8c1e9c25c73d tempest-ProjectReaderTests-80632435 None] Created volume successfully. Nov 04 19:22:31 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" returned: 0 in 0.420s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:31 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 Nov 04 19:22:31 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:31 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858" returned: 0 in 0.407s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:31 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:32 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858 Nov 04 19:22:32 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:32 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742.9ba543a4-ffea-4fca-891a-0080e65b5858" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-9ba543a4-ffea-4fca-891a-0080e65b5858" released by "_delete_snapshot" :: held 1.639s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" released by "delete_snapshot" :: held 1.661s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Created reservations ['519ff2c8-dc17-49e5-8952-3e8b6aaa6724', 'd824e105-e17d-4e72-a289-8f92abc89f02', 'a6b6c3d6-2a6e-4e6d-9a7e-849178fc7bae', '68e6adfa-ddd4-425c-819e-3199099316f4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:32 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-2da329ae-a4ad-4b52-aa26-2c2d8ea8d77e tempest-ProjectMemberTests-814799006 None] Lock "cinder-9ba543a4-ffea-4fca-891a-0080e65b5858-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Creating offline snapshot 06a1e36d-5123-49de-bed0-8789bcbfc154 of volume 76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a715e5b-a021-448d-b97a-f461d68b3e2f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:32 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 Nov 04 19:22:32 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:32 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "cinder-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" acquired by "delete_volume" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c02d93-74ce-4909-bf0b-23ea2deb12cc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94" returned: 0 in 0.397s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 1G Nov 04 19:22:33 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:33 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 Nov 04 19:22:33 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:33 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" returned: 0 in 0.380s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742 Nov 04 19:22:33 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:33 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 1G" returned: 0 in 0.415s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 Nov 04 19:22:33 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:33 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742" released by "delete_volume" :: held 0.692s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Created reservations ['116ee019-84b0-44e3-9b55-a8dc19a919da', '6f27d0a7-0f0e-4626-980c-dcb952316e9e', '2c08fb48-13ca-4db1-a1c9-97b19adc1dea', 'b3782af5-3913-4d87-b1a7-ffa21009ae32'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:33 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154" returned: 0 in 0.340s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:33 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 is being set with open permissions: ugo+rw Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:33 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:33 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 Nov 04 19:22:33 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:33 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:33 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:34 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:34 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.270s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:34 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:34 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info Nov 04 19:22:34 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-35eb944d-066e-4fa7-a1ae-f7ee01d4bd0d tempest-ProjectMemberTests-814799006 None] Lock "cinder-5bac3e7b-f6a5-4c7b-a556-5f392a6c7742-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:34 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info" returned: 0 in 0.262s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:34 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info is being set with open permissions: ugo+rw Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:34 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info Nov 04 19:22:34 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (b66801bb-e8c1-45cc-a99f-071badea13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90af76a1-35f2-464f-a0d3-1a38e9092a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:34 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.info" returned: 0 in 0.252s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90af76a1-35f2-464f-a0d3-1a38e9092a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223999881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7372ff-ecfd-4768-971c-7bd8e67a9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:35Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fd15ef-aff3-47a2-a63c-131d588a0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fd15ef-aff3-47a2-a63c-131d588a0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b685a7d-097e-4101-b486-0e4c0e32b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b685a7d-097e-4101-b486-0e4c0e32b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7372ff-ecfd-4768-971c-7bd8e67a9c86', 'volume_name': 'volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518288a-9e7b-4a6f-830b-5ee2846869f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518288a-9e7b-4a6f-830b-5ee2846869f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a18366b-ef39-41c4-811a-1f8bd747d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:34 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Volume 5e7372ff-ecfd-4768-971c-7bd8e67a9c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86', 'volume_size': 1} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223999881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7372ff-ecfd-4768-971c-7bd8e67a9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:35Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Creating volume 5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:34 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:34 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:34 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 1073741824 Nov 04 19:22:34 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:34 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-155b72cc-cea8-4dcd-a9f4-259b8112003a tempest-ProjectReaderTests-80632435 None] Create snapshot completed successfully Nov 04 19:22:35 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 1073741824" returned: 0 in 0.417s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:35 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 Nov 04 19:22:35 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:35 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" returned: 0 in 0.279s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a18366b-ef39-41c4-811a-1f8bd747d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f799e2-199a-452d-a108-55d55609356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:35 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Volume volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 (5e7372ff-ecfd-4768-971c-7bd8e67a9c86): created successfully Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f799e2-199a-452d-a108-55d55609356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (b66801bb-e8c1-45cc-a99f-071badea13e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:35 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6269f310-94b5-4f9b-87cb-186eec2a8502 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-06a1e36d-5123-49de-bed0-8789bcbfc154-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-06a1e36d-5123-49de-bed0-8789bcbfc154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-06a1e36d-5123-49de-bed0-8789bcbfc154" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-06a1e36d-5123-49de-bed0-8789bcbfc154" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Deleting offline snapshot 06a1e36d-5123-49de-bed0-8789bcbfc154 of volume 76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] snapshot_file for this snap is: volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c308c218-caa2-4de3-b14f-2ea48743cda3]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:35 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:35 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 Nov 04 19:22:35 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:36 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154" returned: 0 in 0.380s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76a364af-f1bc-45e9-931b-7ece6c5bab94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e9a43-b704-4f40-a420-d7c25b68b888]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:36 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 Nov 04 19:22:36 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:36 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:36 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 Nov 04 19:22:36 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 14ae8cfa-d8a3-4693-b467-83a696a6cf8f of volume 5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd5ce6-84eb-4785-8058-be316470008d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:36 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:37 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 Nov 04 19:22:37 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:37 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154" returned: 0 in 0.389s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:37 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154 Nov 04 19:22:37 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:37 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" returned: 0 in 0.382s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:37 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94.06a1e36d-5123-49de-bed0-8789bcbfc154" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:37 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f 1G Nov 04 19:22:37 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-06a1e36d-5123-49de-bed0-8789bcbfc154" released by "_delete_snapshot" :: held 1.523s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" released by "delete_snapshot" :: held 1.545s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Created reservations ['3605499a-8593-4371-b06a-1f20b98b23d1', 'cd91b59c-f489-4b19-9f40-9f144ae7ccd9', '50a7afa0-afe5-4141-9c6b-140c21c228e7', '53a26fd1-02d6-4f55-9f42-85874d8e07ae'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:37 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Delete snapshot completed successfully. Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-3218f48b-5058-4d5b-b91d-7a570c981c1d tempest-ProjectReaderTests-80632435 None] Lock "cinder-06a1e36d-5123-49de-bed0-8789bcbfc154-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:37 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f 1G" returned: 0 in 0.426s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:37 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f Nov 04 19:22:37 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:37 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-76a364af-f1bc-45e9-931b-7ece6c5bab94-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "cinder-76a364af-f1bc-45e9-931b-7ece6c5bab94-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Acquiring lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:38 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f" returned: 0 in 0.350s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f is being set with open permissions: ugo+rw Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[c691d5ee-b7b3-4c9b-a9ea-d7eff24acb23]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:38 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f Nov 04 19:22:38 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:38 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 Nov 04 19:22:38 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:38 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:38 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info Nov 04 19:22:38 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:38 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94" returned: 0 in 0.407s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:38 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94 Nov 04 19:22:38 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:38 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info is being set with open permissions: ugo+rw Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:38 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info Nov 04 19:22:38 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:38 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-76a364af-f1bc-45e9-931b-7ece6c5bab94" returned: 0 in 0.267s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "cinder-quobyte-76a364af-f1bc-45e9-931b-7ece6c5bab94" released by "delete_volume" :: held 0.751s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Created reservations ['1c1032f9-585c-481d-bb8e-30f39d0f8d83', '476d8919-cf71-4546-8cfc-4c997f526a02', 'faf71c2f-e8ac-4275-bf69-9cedac706455', '9914587d-68e7-4113-bb04-ecfde5bb2100'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:38 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.info" returned: 0 in 0.306s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:38 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-dbd145f9-9efb-4a9d-ada2-c7c4b37062a1 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:39 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:39 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:39 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:39 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Deleted volume successfully. Nov 04 19:22:39 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-442fc936-b221-44da-bb31-eeb9c2fcdcaa tempest-ProjectReaderTests-80632435 None] Lock "cinder-76a364af-f1bc-45e9-931b-7ece6c5bab94-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-14ae8cfa-d8a3-4693-b467-83a696a6cf8f-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-14ae8cfa-d8a3-4693-b467-83a696a6cf8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-14ae8cfa-d8a3-4693-b467-83a696a6cf8f" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-14ae8cfa-d8a3-4693-b467-83a696a6cf8f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 14ae8cfa-d8a3-4693-b467-83a696a6cf8f of volume 5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db05a68-b2a9-493d-a395-f627a56a56cc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:40 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f Nov 04 19:22:40 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:40 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca034517-164b-460d-ae1b-3c63345703b7]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:40 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:40 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 Nov 04 19:22:40 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:41 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" returned: 0 in 0.403s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:41 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f Nov 04 19:22:41 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:41 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f" returned: 0 in 0.368s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:41 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f Nov 04 19:22:41 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:41 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86.14ae8cfa-d8a3-4693-b467-83a696a6cf8f" returned: 0 in 0.266s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-14ae8cfa-d8a3-4693-b467-83a696a6cf8f" released by "_delete_snapshot" :: held 1.567s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" released by "delete_snapshot" :: held 1.593s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Created reservations ['d01b6fe4-ebf8-435a-97f9-4566db14a4c5', '54eac5b9-09ab-4e3a-839f-3632371eecc4', '79e6ec6b-08f2-4d15-a2db-9510a3dfe7f3', '318dfdcb-0508-42b5-858a-cf284bda51cc'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:41 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:41 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-940ee78b-29fc-46f4-913e-0305f0a93bc1 tempest-ProjectMemberTests-814799006 None] Lock "cinder-14ae8cfa-d8a3-4693-b467-83a696a6cf8f-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-5e7372ff-ecfd-4768-971c-7bd8e67a9c86-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "cinder-5e7372ff-ecfd-4768-971c-7bd8e67a9c86-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf30ca-d15a-4d56-88fa-85cd2b42ff64]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:42 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 Nov 04 19:22:42 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:42 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" returned: 0 in 0.383s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:42 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:42 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86 Nov 04 19:22:42 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:43 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-5e7372ff-ecfd-4768-971c-7bd8e67a9c86" released by "delete_volume" :: held 0.717s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Created reservations ['db879823-4232-413a-a4d4-bb8f062a0cf0', '04c2eace-ade4-49de-bffd-86043b82f13e', 'be1d7844-8af3-4963-9e7f-fd651e24a748', '6aa69710-df55-4327-9cf6-2334dd68a493'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:43 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:43 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:43 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:43 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5cb8bc4-80d6-40c6-b5f8-8bd43c0c7d37 tempest-ProjectMemberTests-814799006 None] Lock "cinder-5e7372ff-ecfd-4768-971c-7bd8e67a9c86-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (0a88ed03-1261-4e86-b4e1-1a1770e90608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:43 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141c19d-d285-4b9f-9a58-7503d552e69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0141c19d-d285-4b9f-9a58-7503d552e69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405158642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:44Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43127a2-0a83-45c4-b545-c6cc4efd27d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43127a2-0a83-45c4-b545-c6cc4efd27d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d384bba0-4dca-4629-be5d-e155d9381e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d384bba0-4dca-4629-be5d-e155d9381e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd', 'volume_name': 'volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af332a65-846e-447d-9a25-0726f08a7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af332a65-846e-447d-9a25-0726f08a7856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dae88e-7cc4-4608-8e0e-2ca58a0b7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Volume e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd', 'volume_size': 1} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405158642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:44Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Creating volume e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:44 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:44 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd 1073741824 Nov 04 19:22:44 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:44 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd 1073741824" returned: 0 in 0.500s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:44 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd Nov 04 19:22:44 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:44 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" returned: 0 in 0.246s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dae88e-7cc4-4608-8e0e-2ca58a0b7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a46efa-ed6e-4d66-b75e-37d8bfa8ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:44 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Volume volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd (e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd): created successfully Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a46efa-ed6e-4d66-b75e-37d8bfa8ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:44 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (0a88ed03-1261-4e86-b4e1-1a1770e90608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:44 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-a17cd9c7-31a6-464a-b49c-9e7d3208a79e tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot ff519e70-5725-4d82-b210-8d0f099cd4d2 of volume e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4d85a-4f76-4d76-9bf9-e56ddd0c563f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:46 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd Nov 04 19:22:46 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:46 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" returned: 0 in 0.379s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:46 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:46 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 1G Nov 04 19:22:46 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:47 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 1G" returned: 0 in 0.392s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:47 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 Nov 04 19:22:47 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:47 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2" returned: 0 in 0.303s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:47 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 is being set with open permissions: ugo+rw Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:47 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 Nov 04 19:22:47 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:47 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:47 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info Nov 04 19:22:47 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:47 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info" returned: 0 in 0.269s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:47 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info is being set with open permissions: ugo+rw Nov 04 19:22:47 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:48 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info Nov 04 19:22:48 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:48 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.info" returned: 0 in 0.275s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:48 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:48 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1d190c51-1b7c-4d45-bc01-97123c3a3c61 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-ff519e70-5725-4d82-b210-8d0f099cd4d2-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-ff519e70-5725-4d82-b210-8d0f099cd4d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-ff519e70-5725-4d82-b210-8d0f099cd4d2" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-ff519e70-5725-4d82-b210-8d0f099cd4d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot ff519e70-5725-4d82-b210-8d0f099cd4d2 of volume e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50110a5-ee50-4e68-b892-fd6b2c9665d9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:49 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 Nov 04 19:22:49 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:49 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c625d-447e-4549-8d76-a8890fcc0abe]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:49 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:49 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd Nov 04 19:22:49 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:50 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" returned: 0 in 0.358s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:50 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 Nov 04 19:22:50 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:50 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2" returned: 0 in 0.336s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:50 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2 Nov 04 19:22:50 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:50 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd.ff519e70-5725-4d82-b210-8d0f099cd4d2" returned: 0 in 0.247s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-ff519e70-5725-4d82-b210-8d0f099cd4d2" released by "_delete_snapshot" :: held 1.402s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" released by "delete_snapshot" :: held 1.425s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Created reservations ['48d75b0e-7c01-4338-9652-d92b100c943d', '0d9669a1-0073-4ed8-8a7d-bdad0a53facc', '7b4e6bc2-6e79-42d3-befb-4960fa6a2f3d', 'c16ed193-c785-4af6-9641-14d6f1145a0d'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:50 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:50 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-255e1dd6-9fd9-4c8c-9529-cdcced944e60 tempest-ProjectMemberTests-814799006 None] Lock "cinder-ff519e70-5725-4d82-b210-8d0f099cd4d2-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "cinder-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47c1c98-8589-4557-ba12-928af7d559d1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:51 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd Nov 04 19:22:51 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:51 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:51 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:52 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd Nov 04 19:22:52 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:52 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd" released by "delete_volume" :: held 0.669s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Created reservations ['80a6f084-4aa3-41db-a10a-a90f07e0e999', '98e54b33-250f-4f2d-bab4-074ce3d51c17', '750f4bef-454d-4dfc-8351-22e945da595f', '7c30f8eb-f4b1-4de2-a652-11d038ec1128'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:52 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:52 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:52 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:52 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:52 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cbef1058-917e-454a-873a-987f9fa15b50 tempest-ProjectMemberTests-814799006 None] Lock "cinder-e8fbd901-1cfd-4600-ac0d-bf44bc1d89fd-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (540856ee-2045-41c9-a57c-28777dd499f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd9b57c-64e1-4673-b7c4-055b595ad18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd9b57c-64e1-4673-b7c4-055b595ad18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870816967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b000c9d-6f23-4d23-8242-1aa5a81dc91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:53Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddef314c-9c89-4d3d-9682-8b770b9fdb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddef314c-9c89-4d3d-9682-8b770b9fdb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f751c-8408-49b7-bd9a-a17dcb8bfb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f751c-8408-49b7-bd9a-a17dcb8bfb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b000c9d-6f23-4d23-8242-1aa5a81dc91b', 'volume_name': 'volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25adde7f-3c93-4557-a534-6d3af2ac0adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25adde7f-3c93-4557-a534-6d3af2ac0adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ec03a2-78fc-4c1f-8489-30bc7d32e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Volume 1b000c9d-6f23-4d23-8242-1aa5a81dc91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b', 'volume_size': 1} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870816967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b000c9d-6f23-4d23-8242-1aa5a81dc91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:22:53Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Creating volume 1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:22:53 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:53 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b 1073741824 Nov 04 19:22:53 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:53 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b 1073741824" returned: 0 in 0.410s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:53 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b Nov 04 19:22:53 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:53 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" returned: 0 in 0.259s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ec03a2-78fc-4c1f-8489-30bc7d32e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0508a871-fabb-4a09-a9b6-dc640a168ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:22:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Volume volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b (1b000c9d-6f23-4d23-8242-1aa5a81dc91b): created successfully Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0508a871-fabb-4a09-a9b6-dc640a168ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:22:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (540856ee-2045-41c9-a57c-28777dd499f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:22:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-daa813db-df71-4259-b89a-2958997780e6 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 8709413e-ae68-47f8-bc24-f26da39d083b of volume 1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f0ce71-a846-4681-a1c2-9f37ac6a0880]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:54 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b Nov 04 19:22:54 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:54 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" returned: 0 in 0.360s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:54 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b 1G Nov 04 19:22:54 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:55 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b 1G" returned: 0 in 0.390s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:55 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b Nov 04 19:22:55 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:55 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b" returned: 0 in 0.288s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b is being set with open permissions: ugo+rw Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:55 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b Nov 04 19:22:55 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:55 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b" returned: 0 in 0.270s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:55 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info Nov 04 19:22:55 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:55 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info" returned: 0 in 0.265s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info is being set with open permissions: ugo+rw Nov 04 19:22:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:55 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info Nov 04 19:22:55 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:56 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.info" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-2430ccba-d51a-4a3b-8466-02301bc2a69d tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-8709413e-ae68-47f8-bc24-f26da39d083b-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-8709413e-ae68-47f8-bc24-f26da39d083b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-8709413e-ae68-47f8-bc24-f26da39d083b" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-8709413e-ae68-47f8-bc24-f26da39d083b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 8709413e-ae68-47f8-bc24-f26da39d083b of volume 1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95e59e-f20b-4b6f-86ef-7764dc1225d0]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:56 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b Nov 04 19:22:56 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:56 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b" returned: 0 in 0.363s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[02024daf-a05e-470d-a870-0ff19319b9e8]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:57 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b Nov 04 19:22:57 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:57 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" returned: 0 in 0.356s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:57 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b Nov 04 19:22:57 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:57 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b" returned: 0 in 0.327s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:57 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b Nov 04 19:22:57 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:57 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b.8709413e-ae68-47f8-bc24-f26da39d083b" returned: 0 in 0.234s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-8709413e-ae68-47f8-bc24-f26da39d083b" released by "_delete_snapshot" :: held 1.380s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" released by "delete_snapshot" :: held 1.402s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Created reservations ['9219e908-515d-4815-8cce-266f2c315242', 'f4bf7a57-01a2-44c6-b29d-4e38d65a3ec5', 'b819d310-89b6-4f13-8746-348a5e512428', '141b6a30-8c3b-42b8-9eb5-c1991d67b257'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:57 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:22:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-4443c051-ef98-4dad-9b72-4c3215ab7ce6 tempest-ProjectMemberTests-814799006 None] Lock "cinder-8709413e-ae68-47f8-bc24-f26da39d083b-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-1b000c9d-6f23-4d23-8242-1aa5a81dc91b-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "cinder-1b000c9d-6f23-4d23-8242-1aa5a81dc91b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" acquired by "delete_volume" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798536a-f7e9-4be8-8998-f7e36e6d4090]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:22:58 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:58 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b Nov 04 19:22:58 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:59 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" returned: 0 in 0.375s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:59 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b Nov 04 19:22:59 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:59 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-1b000c9d-6f23-4d23-8242-1aa5a81dc91b" released by "delete_volume" :: held 0.679s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Created reservations ['3f332aae-722a-4334-b975-82c86f162195', 'df18efef-2f36-4f86-b157-229d7f7633e1', '6e9e4bdb-18fc-4a09-b718-01541313899e', 'f575e752-b5cf-4b5d-b4ee-1279dc985d82'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:22:59 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:22:59 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:22:59 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.239s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:22:59 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:22:59 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-0ec0fb7f-b5e4-4375-bf89-92c2f7005fb3 tempest-ProjectMemberTests-814799006 None] Lock "cinder-1b000c9d-6f23-4d23-8242-1aa5a81dc91b-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (9a345d72-ea37-45fb-8043-f0bd6b2169ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ab24c6-4e2f-4a58-b3bb-92d111a816ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ab24c6-4e2f-4a58-b3bb-92d111a816ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935311260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233a6ee8-24d6-4d4d-b515-2ceb871891b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:00Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce25c6e-cc7e-4665-b057-20bee49b3673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce25c6e-cc7e-4665-b057-20bee49b3673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967f0d81-57cf-4d0d-8bd0-6e3c2656c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967f0d81-57cf-4d0d-8bd0-6e3c2656c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233a6ee8-24d6-4d4d-b515-2ceb871891b2', 'volume_name': 'volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34615ea5-9881-4026-8b1a-de262fdc6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34615ea5-9881-4026-8b1a-de262fdc6faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f951403-683d-4f52-9d2b-ca06058b48ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Volume 233a6ee8-24d6-4d4d-b515-2ceb871891b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2', 'volume_size': 1} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935311260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233a6ee8-24d6-4d4d-b515-2ceb871891b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:00Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Creating volume 233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:00 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:00 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 1073741824 Nov 04 19:23:00 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:00 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 1073741824" returned: 0 in 0.391s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:00 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 Nov 04 19:23:00 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:00 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f951403-683d-4f52-9d2b-ca06058b48ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7474721b-0f24-4978-8f7d-7dd60ff93df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:00 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Volume volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 (233a6ee8-24d6-4d4d-b515-2ceb871891b2): created successfully Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7474721b-0f24-4978-8f7d-7dd60ff93df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:00 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (9a345d72-ea37-45fb-8043-f0bd6b2169ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:00 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-fdddef28-72ae-4ad2-80da-300724c9c4e0 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot fea64dd2-6396-407a-b26d-2c27451a06c6 of volume 233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e786a443-3a8d-4c2a-9386-608352f2a75f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:01 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 Nov 04 19:23:01 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:01 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2" returned: 0 in 0.351s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:01 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:01 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 1G Nov 04 19:23:01 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:02 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 1G" returned: 0 in 0.397s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:02 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 Nov 04 19:23:02 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:02 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6" returned: 0 in 0.296s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:02 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 is being set with open permissions: ugo+rw Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:02 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 Nov 04 19:23:02 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:02 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6" returned: 0 in 0.237s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:02 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info Nov 04 19:23:02 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:02 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:02 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info is being set with open permissions: ugo+rw Nov 04 19:23:02 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:02 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info Nov 04 19:23:02 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:03 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.info" returned: 0 in 0.293s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:03 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-4b2ce5fd-3a37-40e3-8457-bfff5208a1b8 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-fea64dd2-6396-407a-b26d-2c27451a06c6-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-fea64dd2-6396-407a-b26d-2c27451a06c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-fea64dd2-6396-407a-b26d-2c27451a06c6" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-fea64dd2-6396-407a-b26d-2c27451a06c6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot fea64dd2-6396-407a-b26d-2c27451a06c6 of volume 233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1ea8d0-a7f7-4475-b544-d81dc88ab202]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:03 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 Nov 04 19:23:03 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:03 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6" returned: 0 in 0.373s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967a70b-a048-487a-b1a6-66df382ea5d6]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:04 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 Nov 04 19:23:04 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:04 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:04 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 Nov 04 19:23:04 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:04 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:04 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6 Nov 04 19:23:04 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:04 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2.fea64dd2-6396-407a-b26d-2c27451a06c6" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-fea64dd2-6396-407a-b26d-2c27451a06c6" released by "_delete_snapshot" :: held 1.467s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" released by "delete_snapshot" :: held 1.489s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:04 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=240,cinder:SELECT=164,cinder:INSERT=64,cinder:DELETE=17 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Created reservations ['5a8f2c4c-e32b-4a55-8c72-d90c72b5eb3b', '3af476a2-0a29-4bad-86b1-1a24cb2f0c23', '427e7947-fb8b-410b-8b56-2ec6401ea1a3', 'fa466c07-a949-4273-b28e-b540648ddfca'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:05 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-c5116d40-134a-40d9-9fdd-f48b8a2f9abf tempest-ProjectMemberTests-814799006 None] Lock "cinder-fea64dd2-6396-407a-b26d-2c27451a06c6-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-233a6ee8-24d6-4d4d-b515-2ceb871891b2-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-233a6ee8-24d6-4d4d-b515-2ceb871891b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=191,cinder:UPDATE=232,cinder:INSERT=61,cinder:DELETE=21 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d2ab5-b85b-47d0-b791-a94411571a3d]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:05 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 Nov 04 19:23:05 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:06 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:06 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2 Nov 04 19:23:06 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:06 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-233a6ee8-24d6-4d4d-b515-2ceb871891b2" returned: 0 in 0.254s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-233a6ee8-24d6-4d4d-b515-2ceb871891b2" released by "delete_volume" :: held 0.686s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Created reservations ['63d112b1-b65a-425d-b62e-5ff0b437afb4', '90847a8c-2b88-456c-ace7-23da6a99cdd4', '8e539de6-33fa-47d1-901a-d941016a613b', 'ead1691b-072b-4630-bdb7-b16121a4d33a'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:06 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:23:06 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:06 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:23:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:23:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-771ffc26-4cd7-495d-8dcc-b292bfec8be0 tempest-ProjectMemberTests-814799006 None] Lock "cinder-233a6ee8-24d6-4d4d-b515-2ceb871891b2-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (49f04bc0-d69a-4443-a43c-a1e8ef197a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612c3d05-f737-4088-9a82-2777151ac45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612c3d05-f737-4088-9a82-2777151ac45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222753536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551830f0-6458-4615-b351-35f94f4b4d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:07Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e2cee3-e119-42e6-a6bd-41e7afc143c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e2cee3-e119-42e6-a6bd-41e7afc143c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61ad9a8-8248-4f66-9353-382e5743b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61ad9a8-8248-4f66-9353-382e5743b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551830f0-6458-4615-b351-35f94f4b4d74', 'volume_name': 'volume-551830f0-6458-4615-b351-35f94f4b4d74', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34ab237-fffe-4a37-9678-0d1fdb7d5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34ab237-fffe-4a37-9678-0d1fdb7d5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2615b4-c37f-476f-9875-46d215a89259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:07 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Volume 551830f0-6458-4615-b351-35f94f4b4d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551830f0-6458-4615-b351-35f94f4b4d74', 'volume_size': 1} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222753536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551830f0-6458-4615-b351-35f94f4b4d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b421c4c5ff42e19378cafb9061e139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:07Z,use_quota=True,user_id='1803cd2ee25f4ac88df289422b957cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Creating volume 551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:07 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:07 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 1073741824 Nov 04 19:23:07 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:07 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 1073741824" returned: 0 in 0.422s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:07 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 Nov 04 19:23:07 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:07 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74" returned: 0 in 0.253s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:07 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2615b4-c37f-476f-9875-46d215a89259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551830f0-6458-4615-b351-35f94f4b4d74', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6106b886-1b99-4502-9df9-f97b6e69d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:08 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Volume volume-551830f0-6458-4615-b351-35f94f4b4d74 (551830f0-6458-4615-b351-35f94f4b4d74): created successfully Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6106b886-1b99-4502-9df9-f97b6e69d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Flow 'volume_create_manager' (49f04bc0-d69a-4443-a43c-a1e8ef197a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-ebabf8fb-04ed-462a-879f-a7f836e2fe28 tempest-ProjectMemberTests-814799006 None] Created volume successfully. Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Creating offline snapshot 4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 of volume 551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a4558-bf1a-430d-94b1-493ab5fc5a54]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:08 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 Nov 04 19:23:08 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:08 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74" returned: 0 in 0.365s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:08 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 1G Nov 04 19:23:08 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:09 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 1G" returned: 0 in 0.399s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551830f0-6458-4615-b351-35f94f4b4d74 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:09 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551830f0-6458-4615-b351-35f94f4b4d74 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 Nov 04 19:23:09 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:09 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-551830f0-6458-4615-b351-35f94f4b4d74 -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" returned: 0 in 0.318s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:09 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 is being set with open permissions: ugo+rw Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:09 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 Nov 04 19:23:09 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:09 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:09 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info Nov 04 19:23:09 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:09 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:10 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info is being set with open permissions: ugo+rw Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:10 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info Nov 04 19:23:10 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:10 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.info" returned: 0 in 0.255s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:10 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-b97a73bb-5df3-49c6-9779-4f3c240fcae5 tempest-ProjectMemberTests-814799006 None] Create snapshot completed successfully Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Deleting offline snapshot 4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 of volume 551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] snapshot_file for this snap is: volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a95a5a7-bcd4-4e1f-a746-318d3af09adb]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:10 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:10 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 Nov 04 19:23:10 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:11 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-551830f0-6458-4615-b351-35f94f4b4d74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c1856-3842-4aa0-8a68-c59e1bf85f5f]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:11 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 Nov 04 19:23:11 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:11 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74" returned: 0 in 0.366s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:11 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 Nov 04 19:23:11 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:11 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" returned: 0 in 0.327s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:11 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:11 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76 Nov 04 19:23:11 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:12 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74.4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" returned: 0 in 0.242s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76" released by "_delete_snapshot" :: held 1.397s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" released by "delete_snapshot" :: held 1.420s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Created reservations ['83944d76-15ec-4bce-9eab-d3d30fe5d3bc', '068c1b45-97fe-4489-bff7-f7768fa94b94', '82e2e595-9cd2-4c0d-9cd0-87090b64d33f', '5a144f1d-30e8-4763-8cbf-96513ea3fdd3'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:12 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Delete snapshot completed successfully. Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6207e0d9-4966-4f48-a2bd-2942ab170b85 tempest-ProjectMemberTests-814799006 None] Lock "cinder-4d5ecfd1-6353-4d77-afe2-b5b5c9bc8e76-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-551830f0-6458-4615-b351-35f94f4b4d74-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "cinder-551830f0-6458-4615-b351-35f94f4b4d74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Acquiring lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" acquired by "delete_volume" :: waited 0.016s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba19ec0-0015-4d1c-a788-ee6768764448]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:12 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:13 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 Nov 04 19:23:13 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:13 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74" returned: 0 in 0.354s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:13 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74 Nov 04 19:23:13 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:13 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-551830f0-6458-4615-b351-35f94f4b4d74" returned: 0 in 0.248s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "cinder-quobyte-551830f0-6458-4615-b351-35f94f4b4d74" released by "delete_volume" :: held 0.662s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Created reservations ['cfcd62d5-0e4d-422c-a90b-f3acf98e053b', 'cfffa066-8ac2-4c43-806b-15694d803d45', '5fa84475-3c86-4ab3-88cc-5b7e93a0e3e2', 'e8d1b30c-c190-4a2f-8737-b2265292d8f9'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:13 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:23:13 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:13 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.245s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:23:13 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Deleted volume successfully. Nov 04 19:23:13 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-cb4822b8-e338-4dcd-9ebd-6d922d5a0d57 tempest-ProjectMemberTests-814799006 None] Lock "cinder-551830f0-6458-4615-b351-35f94f4b4d74-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Flow 'volume_create_manager' (f00ed8a5-391a-48f0-bc33-1ad6b2924008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e3b75-3b66-4365-b57b-8e74b5f0808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286e3b75-3b66-4365-b57b-8e74b5f0808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226403062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7b855-d050-4d06-8dd0-41512f46be86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bb9081fd5f4e01aebaf326e76b7a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:18Z,use_quota=True,user_id='c7df8a9ea7334a449887384496d963d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a75389d-16ac-4b77-9f11-05f3ff5b1ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a75389d-16ac-4b77-9f11-05f3ff5b1ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e8ef1e-d02a-463c-bf23-3a0577a267f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e8ef1e-d02a-463c-bf23-3a0577a267f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e7b855-d050-4d06-8dd0-41512f46be86', 'volume_name': 'volume-52e7b855-d050-4d06-8dd0-41512f46be86', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96160733-1583-44bc-9786-a9f37482e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96160733-1583-44bc-9786-a9f37482e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e86f8-5415-46ee-98ab-bfbf31d501ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:17 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Volume 52e7b855-d050-4d06-8dd0-41512f46be86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e7b855-d050-4d06-8dd0-41512f46be86', 'volume_size': 1} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226403062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7b855-d050-4d06-8dd0-41512f46be86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bb9081fd5f4e01aebaf326e76b7a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:18Z,use_quota=True,user_id='c7df8a9ea7334a449887384496d963d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Creating volume 52e7b855-d050-4d06-8dd0-41512f46be86 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:17 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:23:17 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:17 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 1073741824 Nov 04 19:23:17 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:18 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 1073741824" returned: 0 in 0.419s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:18 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 Nov 04 19:23:18 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:18 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86" returned: 0 in 0.244s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e86f8-5415-46ee-98ab-bfbf31d501ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e7b855-d050-4d06-8dd0-41512f46be86', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07341128-77a6-4b19-8bd3-0c49ccfa03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:18 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Volume volume-52e7b855-d050-4d06-8dd0-41512f46be86 (52e7b855-d050-4d06-8dd0-41512f46be86): created successfully Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07341128-77a6-4b19-8bd3-0c49ccfa03f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Flow 'volume_create_manager' (f00ed8a5-391a-48f0-bc33-1ad6b2924008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:18 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-74c7b95f-b49f-4849-bb88-eee8d15c0a2c tempest-ProjectReaderTests-680197414 None] Created volume successfully. Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Acquiring lock "cinder-52e7b855-d050-4d06-8dd0-41512f46be86-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "cinder-52e7b855-d050-4d06-8dd0-41512f46be86-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Acquiring lock "cinder-quobyte-52e7b855-d050-4d06-8dd0-41512f46be86" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "cinder-quobyte-52e7b855-d050-4d06-8dd0-41512f46be86" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd178d28-c65a-45b0-8e17-e3ee468c3f96]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:18 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:18 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 Nov 04 19:23:18 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:19 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86" returned: 0 in 0.370s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:19 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86 Nov 04 19:23:19 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:19 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-52e7b855-d050-4d06-8dd0-41512f46be86" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "cinder-quobyte-52e7b855-d050-4d06-8dd0-41512f46be86" released by "delete_volume" :: held 0.683s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Created reservations ['14053cdf-8427-43f1-9211-bc7212dda067', '1dbebf70-35a6-4894-934e-90253e6b159e', '0f8ce7a8-a92f-4fba-bb47-9ee96f4b0c3b', '8fd0b7ca-1f9f-4337-a470-0d4ea0b5c081'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:19 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:23:19 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:19 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.252s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:23:19 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Deleted volume successfully. Nov 04 19:23:19 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-8322249f-4fd1-4a18-9371-c30f4a3531a2 tempest-ProjectReaderTests-680197414 None] Lock "cinder-52e7b855-d050-4d06-8dd0-41512f46be86-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Flow 'volume_create_manager' (c1e388f5-eac3-4f27-a04c-214cf1ad9a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322d6c70-b39b-4b0f-83b3-2b3ac322e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322d6c70-b39b-4b0f-83b3-2b3ac322e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662261661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7b9b2c-dc73-437e-957f-0e332f5ec176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bb9081fd5f4e01aebaf326e76b7a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:20Z,use_quota=True,user_id='c7df8a9ea7334a449887384496d963d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddd57d8-20ff-4826-93b8-0b99611dabec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddd57d8-20ff-4826-93b8-0b99611dabec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21017674-be5a-4d9b-ac6b-1def0ee47d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21017674-be5a-4d9b-ac6b-1def0ee47d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7b9b2c-dc73-437e-957f-0e332f5ec176', 'volume_name': 'volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e2e97e-dd0b-48cb-8cf1-0b4018022a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e2e97e-dd0b-48cb-8cf1-0b4018022a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb28476c-48b2-493a-aaf0-2a2eb00ae742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:20 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Volume 8c7b9b2c-dc73-437e-957f-0e332f5ec176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176', 'volume_size': 1} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662261661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7b9b2c-dc73-437e-957f-0e332f5ec176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bb9081fd5f4e01aebaf326e76b7a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:20Z,use_quota=True,user_id='c7df8a9ea7334a449887384496d963d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Creating volume 8c7b9b2c-dc73-437e-957f-0e332f5ec176 {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:20 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:20 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 1073741824 Nov 04 19:23:20 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:20 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 1073741824" returned: 0 in 0.458s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:20 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:20 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 Nov 04 19:23:20 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:21 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176" returned: 0 in 0.250s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb28476c-48b2-493a-aaf0-2a2eb00ae742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f01865-8792-43c0-bfba-e461d380ad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:21 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Volume volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 (8c7b9b2c-dc73-437e-957f-0e332f5ec176): created successfully Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f01865-8792-43c0-bfba-e461d380ad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Flow 'volume_create_manager' (c1e388f5-eac3-4f27-a04c-214cf1ad9a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:21 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-07fadd20-ec2a-465a-aad0-704568f0c2f0 tempest-ProjectReaderTests-680197414 None] Created volume successfully. Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Acquiring lock "cinder-8c7b9b2c-dc73-437e-957f-0e332f5ec176-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "cinder-8c7b9b2c-dc73-437e-957f-0e332f5ec176-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Acquiring lock "cinder-quobyte-8c7b9b2c-dc73-437e-957f-0e332f5ec176" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "cinder-quobyte-8c7b9b2c-dc73-437e-957f-0e332f5ec176" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a565b6-b68b-466f-ac83-f58bb624cccc]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:21 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 Nov 04 19:23:21 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:21 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176" returned: 0 in 0.374s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:21 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:21 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176 Nov 04 19:23:21 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:22 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-8c7b9b2c-dc73-437e-957f-0e332f5ec176" returned: 0 in 0.252s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "cinder-quobyte-8c7b9b2c-dc73-437e-957f-0e332f5ec176" released by "delete_volume" :: held 0.669s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Created reservations ['4fb52f21-6b62-4f04-bc5d-599d84acb5cc', '9d858e7b-eb10-4dee-8526-bd07cc7d5747', '5e731dd8-6d11-4bbc-b319-46c57c9dade5', 'd9981b0d-ca89-47cd-baff-a3a0728461d1'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:22 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:23:22 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:22 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:23:22 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:22 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.256s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:23:22 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.272s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:23:22 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Deleted volume successfully. Nov 04 19:23:22 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-09e907b1-6779-46ef-83aa-65a9c6917398 tempest-ProjectReaderTests-680197414 None] Lock "cinder-8c7b9b2c-dc73-437e-957f-0e332f5ec176-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:23:32 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=31,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=5 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:32 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:50 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:UPDATE=1 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Flow 'volume_create_manager' (264f3d19-4698-4afa-b536-ee15a8922809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cc8d53-680c-445e-8755-c0593f396abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cc8d53-680c-445e-8755-c0593f396abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-838916968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2152f4a0-922a-411c-b679-3bea6f24c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04551887a2e84893a6900bdb786fa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:53Z,use_quota=True,user_id='94569cc0fbfb4117925c6daba4aa6f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93e5d45-f60d-4e6a-ad61-f4abbe3f8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93e5d45-f60d-4e6a-ad61-f4abbe3f8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed5c136-515a-431e-8c5c-18a707c758b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed5c136-515a-431e-8c5c-18a707c758b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2152f4a0-922a-411c-b679-3bea6f24c18d', 'volume_name': 'volume-2152f4a0-922a-411c-b679-3bea6f24c18d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedb6118-d32b-4cc0-bb71-5249edfe828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedb6118-d32b-4cc0-bb71-5249edfe828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e961df-9367-4e6d-a0d4-cee16e4c35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Volume 2152f4a0-922a-411c-b679-3bea6f24c18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2152f4a0-922a-411c-b679-3bea6f24c18d', 'volume_size': 1} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-838916968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2152f4a0-922a-411c-b679-3bea6f24c18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04551887a2e84893a6900bdb786fa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:53Z,use_quota=True,user_id='94569cc0fbfb4117925c6daba4aa6f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)}" {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Creating volume 2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:53 devstack cinder-volume[87367]: INFO cinder.volume.drivers.remotefs [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] casted to osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d 1073741824 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:53 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d 1073741824 Nov 04 19:23:53 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:53 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d 1073741824" returned: 0 in 0.401s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:53 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:23:53 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:53 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.240s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'} {{(pid=87367) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e961df-9367-4e6d-a0d4-cee16e4c35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2152f4a0-922a-411c-b679-3bea6f24c18d', 'volume_size': 1}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d42c0-0de9-4291-beaa-1c7b0f773887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:53 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Volume volume-2152f4a0-922a-411c-b679-3bea6f24c18d (2152f4a0-922a-411c-b679-3bea6f24c18d): created successfully Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d42c0-0de9-4291-beaa-1c7b0f773887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:53 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Flow 'volume_create_manager' (264f3d19-4698-4afa-b536-ee15a8922809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:53 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-17747936-84a9-450f-8be4-f76a0b1f60c2 tempest-SnapshotDependencyTests-2126708664 None] Created volume successfully. Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Creating offline snapshot eed459ed-ed5f-410e-ab0c-8ecd39281b5a of volume 2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbedb5-19c3-4777-b89f-3033d8c6d194]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:54 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:23:54 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:54 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.375s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:54 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a 1G {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:54 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a 1G Nov 04 19:23:54 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:55 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a 1G" returned: 0 in 0.386s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2152f4a0-922a-411c-b679-3bea6f24c18d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:55 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2152f4a0-922a-411c-b679-3bea6f24c18d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:23:55 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:55 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2152f4a0-922a-411c-b679-3bea6f24c18d -F qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.297s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a is being set with open permissions: ugo+rw Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:55 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:23:55 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:55 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:55 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info Nov 04 19:23:55 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:55 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info" returned: 0 in 0.258s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:55 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info is being set with open permissions: ugo+rw Nov 04 19:23:55 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:55 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info Nov 04 19:23:55 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:56 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.info" returned: 0 in 0.264s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:56 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:56 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-eeb763e5-a955-469c-bde5-f2b8eaac27d0 tempest-SnapshotDependencyTests-2126708664 None] Create snapshot completed successfully Nov 04 19:23:56 devstack cinder-volume[87367]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87367) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Flow 'volume_create_manager' (44a0f70b-188d-454b-806c-03b0ca3eaddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a132df3-1cfd-499c-80e4-533c9e325853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a132df3-1cfd-499c-80e4-533c9e325853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810ca363-d0bb-40f9-88c3-473b120d3174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04551887a2e84893a6900bdb786fa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eed459ed-ed5f-410e-ab0c-8ecd39281b5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:23:57Z,use_quota=True,user_id='94569cc0fbfb4117925c6daba4aa6f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c744c68c-7e6f-4ddf-a6e1-f8d69a061a38),volume_type_id=c744c68c-7e6f-4ddf-a6e1-f8d69a061a38)' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4772548-755d-43ff-9189-575a6ed2bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4772548-755d-43ff-9189-575a6ed2bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619896c-597b-40dc-944e-e937d688ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619896c-597b-40dc-944e-e937d688ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '810ca363-d0bb-40f9-88c3-473b120d3174', 'volume_name': 'volume-810ca363-d0bb-40f9-88c3-473b120d3174', 'volume_size': 1, 'snapshot_id': 'eed459ed-ed5f-410e-ab0c-8ecd39281b5a'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63a9c0-0d7a-4318-a959-ef384811055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c63a9c0-0d7a-4318-a959-ef384811055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e0dc83-55b1-4db5-b4b6-fb4903d0a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:23:57 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Volume 810ca363-d0bb-40f9-88c3-473b120d3174: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-810ca363-d0bb-40f9-88c3-473b120d3174', 'volume_size': 1, 'snapshot_id': 'eed459ed-ed5f-410e-ab0c-8ecd39281b5a'} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-810ca363-d0bb-40f9-88c3-473b120d3174" by "_create_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-810ca363-d0bb-40f9-88c3-473b120d3174" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Creating volume 810ca363-d0bb-40f9-88c3-473b120d3174 from snapshot eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Selected osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f as target Quobyte volume. {{(pid=87367) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" by "_copy_volume_from_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] snapshot: eed459ed-ed5f-410e-ab0c-8ecd39281b5a, volume: 810ca363-d0bb-40f9-88c3-473b120d3174, {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5943ae-ee15-4cb5-b98c-7a82f04469a9]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:57 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:23:57 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:57 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.361s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2152f4a0-922a-411c-b679-3bea6f24c18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222d419-80f5-46e1-8470-e387a40397c2]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:57 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:23:57 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:23:57 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Creating direct copy from snapshot {{(pid=87367) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG cinder.utils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Path /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 not found in is_blk_device check {{(pid=87367) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:23:57 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:23:57 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 Nov 04 19:23:57 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:03 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174" returned: 0 in 5.803s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:03 devstack cinder-volume[87367]: DEBUG cinder.image.image_utils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 {{(pid=87367) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:24:03 devstack cinder-volume[87367]: INFO cinder.image.image_utils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Converted 1024.00 MB image at 176.40 MB/s Nov 04 19:24:03 devstack cinder-volume[87367]: WARNING cinder.volume.drivers.remotefs [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 is being set with open permissions: ugo+rw Nov 04 19:24:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:03 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 Nov 04 19:24:03 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:03 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:03 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174" returned: 0 in 0.236s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:03 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" released by "_copy_volume_from_snapshot" :: held 6.827s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-810ca363-d0bb-40f9-88c3-473b120d3174" released by "_create_volume_from_snapshot" :: held 6.886s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.900s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e0dc83-55b1-4db5-b4b6-fb4903d0a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810ca363-d0bb-40f9-88c3-473b120d3174', 'volume_size': 1, 'snapshot_id': 'eed459ed-ed5f-410e-ab0c-8ecd39281b5a'}' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62114c2b-0444-4ce7-b7b4-2ca112fed969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:24:04 devstack cinder-volume[87367]: INFO cinder.volume.flows.manager.create_volume [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Volume volume-810ca363-d0bb-40f9-88c3-473b120d3174 (810ca363-d0bb-40f9-88c3-473b120d3174): created successfully Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62114c2b-0444-4ce7-b7b4-2ca112fed969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87367) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Flow 'volume_create_manager' (44a0f70b-188d-454b-806c-03b0ca3eaddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87367) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:24:04 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6f75c68c-ea6d-48a6-af61-eaa74b2a55df tempest-SnapshotDependencyTests-2126708664 None] Created volume successfully. Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-delete_snapshot" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" by "delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a" by "_delete_snapshot" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Deleting offline snapshot eed459ed-ed5f-410e-ab0c-8ecd39281b5a of volume 2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] snapshot_file for this snap is: volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b7234-e149-46fb-8a4b-7ad1079c1931]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:24:04 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:04 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:24:04 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:05 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.347s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.remotefs [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2152f4a0-922a-411c-b679-3bea6f24c18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87367) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12814ef-5d3c-41fa-9a28-c45e346fad1c]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:05 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:24:05 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:05 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.525s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:05 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:05 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:24:05 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:06 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.322s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:06 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a Nov 04 19:24:06 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:06 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d.eed459ed-ed5f-410e-ab0c-8ecd39281b5a" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-eed459ed-ed5f-410e-ab0c-8ecd39281b5a" released by "_delete_snapshot" :: held 1.533s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" released by "delete_snapshot" :: held 1.553s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Created reservations ['43e48ba7-2f40-4193-88bc-c3affc6047dc', '7e03e5a4-5e77-42dd-88c9-e7c8562aed9d', '4d926897-3291-4e5e-baa5-592ad39ec391', '468dd765-eccc-4a6a-9ccf-5630e1ff5ed4'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:24:06 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Delete snapshot completed successfully. Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-78e1b018-8e7c-423e-b083-13fd2aba4f59 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-eed459ed-ed5f-410e-ab0c-8ecd39281b5a-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-2152f4a0-922a-411c-b679-3bea6f24c18d-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-2152f4a0-922a-411c-b679-3bea6f24c18d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:06 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" acquired by "delete_volume" :: waited 0.018s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd484b4-57f1-4bd4-977f-e5489361af41]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:07 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:24:07 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:07 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.362s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:07 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d Nov 04 19:24:07 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:07 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-2152f4a0-922a-411c-b679-3bea6f24c18d" returned: 0 in 0.243s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-2152f4a0-922a-411c-b679-3bea6f24c18d" released by "delete_volume" :: held 0.668s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Created reservations ['78293ff5-d7f1-4b21-a0cd-40b61c79956b', 'ec1e6c0f-5a85-4daa-b455-96a10686aac4', '54eb8a82-4fb6-4d61-978e-7dc10c26a094', '75f33173-61c0-40d5-9253-cc630a263b54'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:24:07 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:07 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:24:07 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:08 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.286s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:24:08 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Deleted volume successfully. Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-6bb682e4-9657-4b8e-b47c-990c0aba96e0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-2152f4a0-922a-411c-b679-3bea6f24c18d-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-810ca363-d0bb-40f9-88c3-473b120d3174-delete_volume" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-810ca363-d0bb-40f9-88c3-473b120d3174-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" by "delete_volume" {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" acquired by "delete_volume" :: waited 0.015s {{(pid=87367) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo.privsep.daemon [-] privsep: reply[7843e471-e738-4658-9b24-c8f15876bdc1]: (4, 'qcow2') {{(pid=88512) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:08 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 Nov 04 19:24:08 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:08 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174" returned: 0 in 0.360s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:08 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174 Nov 04 19:24:08 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:08 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09/volume-810ca363-d0bb-40f9-88c3-473b120d3174" returned: 0 in 0.238s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-quobyte-810ca363-d0bb-40f9-88c3-473b120d3174" released by "delete_volume" :: held 0.643s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.quota [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Created reservations ['2fef63f6-f5b0-477f-a531-94fa631773e6', '732cd93e-8744-42db-8e43-7c9c73aedd2c', '39ff1982-e261-4542-bfb8-c97e1b29bbc2', '72cddea0-947d-4f98-8f3e-eaedcca8e222'] {{(pid=87367) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:24:08 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:08 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:24:08 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:09 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:09 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.277s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:09 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:24:09 devstack cinder-volume[87367]: INFO cinder.volume.manager [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Deleted volume successfully. Nov 04 19:24:09 devstack cinder-volume[87367]: DEBUG cinder.coordination [None req-1522af04-bf7d-47fd-94b2-315c719aedb0 tempest-SnapshotDependencyTests-2126708664 None] Lock "cinder-810ca363-d0bb-40f9-88c3-473b120d3174-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87367) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:24:18 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:24:19 devstack cinder-volume[87367]: DEBUG dbcounter [-] [87367] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87367) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f': None} {{(pid=87367) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG cinder.volume.drivers.quobyte [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cab330f7-7566-4319-a066-80da83936d9f'] {{(pid=87367) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.lockutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87367) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:24:22 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09 Nov 04 19:24:22 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:24:22 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_concurrency.processutils [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f9dccd8e11ce91b9ff20fa4aca6ed09" returned: 0 in 0.249s {{(pid=87367) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG cinder.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Notifying Schedulers of capabilities ... {{(pid=87367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG oslo_service.periodic_task [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] Running periodic task VolumeManager._thread_info {{(pid=87367) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread count: 28 {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:24:22 devstack cinder-volume[87367]: DEBUG cinder.volume.manager [None req-0de82ef1-e57c-4919-a4af-f3a5a1e47116 None None] thread info: [<_MainThread(MainThread, started 137617440829568)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87367) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}